Apr 02 10:22:46 devstack cinder-volume[72227]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72227) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:22:46 devstack cinder-volume[72227]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72227) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:22:46 devstack cinder-volume[72227]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72227) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:22:47 devstack cinder-volume[72227]: INFO dbcounter [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Registered counter for database cinder Apr 02 10:22:47 devstack cinder-volume[72227]: DEBUG oslo_db.sqlalchemy.engines [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:22:47 devstack cinder-volume[72227]: DEBUG dbcounter [-] [72227] Writer thread running {{(pid=72227) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 10:22:47 devstack cinder-volume[72227]: INFO cinder.rpc [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 10:22:47 devstack cinder-volume[72227]: INFO cinder.rpc [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 10:22:47 devstack cinder-volume[72227]: DEBUG oslo_db.sqlalchemy.engines [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:22:47 devstack cinder-volume[72227]: INFO cinder.volume.manager [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Determined volume DB was empty at startup. Apr 02 10:22:47 devstack cinder-volume[72227]: DEBUG cinder.volume.manager [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72227) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 10:22:47 devstack cinder-volume[72227]: INFO cinder.volume.manager [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 02 10:22:47 devstack cinder-volume[72227]: WARNING stevedore.named [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 10:22:47 devstack cinder-volume[72227]: WARNING castellan.key_manager [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:22:47 devstack cinder-volume[72227]: WARNING cinder.keymgr.conf_key_mgr [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:22:47 devstack cinder-volume[72227]: DEBUG cinder.volume.drivers.lvm [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72227) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 02 10:22:47 devstack cinder-volume[72227]: DEBUG oslo_concurrency.processutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72227) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_concurrency.processutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] CMD "cinder-rtstool verify" returned: 0 in 0.238s {{(pid=72227) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_db.sqlalchemy.engines [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:22:48 devstack cinder-volume[72227]: INFO cinder.rpc [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 02 10:22:48 devstack cinder-volume[72227]: INFO cinder.rpc [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 02 10:22:48 devstack cinder-volume[72227]: WARNING stevedore.named [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 10:22:48 devstack cinder-volume[72227]: WARNING castellan.key_manager [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:22:48 devstack cinder-volume[72227]: INFO cinder.volume.manager [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_db.sqlalchemy.engines [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72227) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:22:48 devstack cinder-volume[72227]: INFO oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Starting 1 workers Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Started child 72337 {{(pid=72227) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Full set of CONF: {{(pid=72227) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] ******************************************************************************** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Configuration options gathered from: {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] ================================================================================ {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] allow_availability_zone_fallback = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] allow_compression_on_image_upload = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] allowed_direct_url_schemes = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] api_rate_limit = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] auth_strategy = keystone {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] az_cache_duration = 3600 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_availability_zone = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_host = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_stats_polling_interval = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backup_api_class = cinder.backup.api.API {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backup_name_template = backup-%s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backup_use_same_host = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backup_use_temp_snapshot = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] chap_password = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] chap_username = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_internal_tenant_project_id = b29dedab6383443f802ddd0d4be8a62d {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_internal_tenant_user_id = d8f3f91229bc47488b51939bab4c4dda {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cloned_volume_same_az = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cluster = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] compression_format = gzip {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] compute_api_class = cinder.compute.nova.API {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] config_dir = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72337]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] config_source = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] control_exchange = openstack {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] debug = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] default_availability_zone = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] default_group_type = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] default_volume_type = lvmdriver-1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] disk_geometry = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] driver_client_cert = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] driver_client_cert_key = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] driver_data_namespace = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] driver_ssl_cert_path = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] driver_ssl_cert_verify = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] driver_use_ssl = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] enable_force_upload = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] enable_new_services = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] enable_unsupported_driver = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] enforce_multipath_for_image_xfer = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] filter_function = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_api_insecure = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_api_ssl_compression = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_ca_certificates_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_catalog_info = image:glance:publicURL {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_num_retries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance_request_timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] goodness_function = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] graceful_shutdown_timeout = 5 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] group_api_class = cinder.group.api.API {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] host = devstack {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_compress_on_upload = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_conversion_address_space_limit = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_conversion_cpu_limit = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_conversion_disable = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_upload_use_cinder_backend = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_upload_use_internal_tenant = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_volume_cache_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_volume_cache_max_count = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] image_volume_cache_max_size_gb = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] init_host_max_objects_retrieval = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] instance_format = [instance: %(uuid)s] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] iscsi_target_flags = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] iscsi_write_cache = on {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] iser_helper = tgtadm {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] iser_ip_address = 192.168.122.149 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] iser_port = 3260 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_color = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_config_append = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_dir = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_options = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_rotate_interval = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_rotate_interval_type = days {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] log_rotation_type = none {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] max_age = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] max_logfile_count = 30 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] max_logfile_size_mb = 200 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] max_over_subscription_ratio = 20.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] message_reap_interval = 86400 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] message_ttl = 2592000 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] migration_create_volume_timeout_secs = 300 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] monkey_patch = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] monkey_patch_modules = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] my_ip = 192.168.122.149 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] no_snapshot_gb_quota = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] num_iser_scan_tries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] num_shell_tries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] num_volume_device_scan_tries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] nvmeof_conn_info_version = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] nvmet_ns_id = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] nvmet_port_id = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_max_limit = 1000 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_volume_ext_list = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_volume_listen_port = 8776 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_volume_use_ssl = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] osapi_volume_workers = 2 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] per_volume_size_limit = -1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] periodic_fuzzy_delay = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] periodic_interval = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] public_endpoint = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] publish_errors = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_backup_gigabytes = 1000 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_backups = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_gigabytes = 1000 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_groups = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_snapshots = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] quota_volumes = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] rate_limit_burst = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] rate_limit_except_level = CRITICAL {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] rate_limit_interval = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] reinit_driver_count = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] replication_device = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] report_discard_supported = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] report_interval = 120 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] reservation_clean_interval = 86400 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] reservation_expire = 86400 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] reserved_image_namespaces = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] reserved_percentage = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] rpc_response_timeout = 120 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] run_external_periodic_tasks = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] scst_target_driver = iscsi {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] scst_target_iqn_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_down_time = 720 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] shell_completion = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] snapshot_name_template = snapshot-%s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] snapshot_same_host = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] split_loggers = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] state_path = /opt/stack/data/cinder {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] storage_availability_zone = nova {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] storage_protocol = iSCSI {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] syslog_log_facility = LOG_USER {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] target_helper = lioadm {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] target_ip_address = 192.168.122.149 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] target_port = 3260 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] target_protocol = iscsi {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] target_secondary_ip_addresses = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] trace_flags = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] transport_url = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] until_refresh = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_chap_auth = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_default_quota_class = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_journal = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_json = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_multipath_for_image_xfer = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_stderr = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] use_syslog = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] verify_glance_signatures = enabled {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_api_class = cinder.volume.api.API {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_backend_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_clear = zero {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_clear_ionice = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_clear_size = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_copy_bps_limit = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_dd_blocksize = 1M {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_name_template = volume-%s {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_service_inithost_offload = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volume_usage_audit_period = month {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] zoning_mode = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_concurrency.disable_process_locking = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.admin_password = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.admin_token = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.admin_user = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_port = 35357 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_protocol = https {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_section = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_type = password {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_uri = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.auth_version = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.cache = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.identity_uri = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.include_service_catalog = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.insecure = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.interface = public {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_password = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcache_username = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.region_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.service_type = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.backend = dogpile.cache.null {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.backend_argument = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.backend_expiration_time = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.config_prefix = cache.oslo {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.debug_cache_backend = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.enable_retry_client = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.enable_socket_keepalive = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.enforce_fips_mode = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.expiration_time = 600 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.hashclient_retry_attempts = 2 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_dead_retry = 300 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_pool_maxsize = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_sasl_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.password = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.proxies = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.redis_db = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.redis_server = localhost:6379 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.retry_attempts = 2 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.retry_delay = 0.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.socket_keepalive_count = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.socket_keepalive_idle = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.socket_keepalive_interval = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.socket_timeout = 1.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.tls_allowed_ciphers = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.tls_cafile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.tls_certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.tls_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.tls_keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cache.username = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] coordination.backend_url = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.asyncio_connection = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.asyncio_slave_connection = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.backend = sqlalchemy {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.connection = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.connection_debug = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.connection_parameters = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.connection_recycle_time = 3600 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.connection_trace = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.db_inc_retry_interval = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.db_max_retries = 20 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.db_max_retry_interval = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.db_retry_interval = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.max_overflow = 50 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.max_pool_size = 5 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.max_retries = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.mysql_wsrep_sync_wait = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.pool_timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.retry_interval = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.slave_connection = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.sqlite_synchronous = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.synchronous_reader = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] database.use_db_reconnect = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72337]: INFO cinder.volume.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.connection_string = messaging:// {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.es_doc_type = notification {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.es_scroll_size = 10000 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.es_scroll_time = 2m {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.filter_error_trace = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.hmac_keys = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.sentinel_service_name = mymaster {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.socket_timeout = 0.1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.trace_requests = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler.trace_sqlalchemy = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler_jaeger.process_tags = {} {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler_jaeger.service_name_prefix = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] profiler_otlp.service_name_prefix = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.enforce_new_defaults = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: WARNING oslo_config.cfg [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.enforce_scope = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.policy_default_rule = default {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.policy_file = policy.yaml {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.group = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.helper_command = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] privsep_osbrick.user = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.group = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.helper_command = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] cinder_sys_admin.user = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.auth_section = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.auth_type = password {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.cafile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.collect_timing = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.insecure = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.send_service_user_token = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.split_loggers = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] service_user.timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.auth_section = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.auth_type = password {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.collect_timing = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.insecure = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.region_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.split_loggers = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] glance.timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.backend_availability_zone = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.chap_password = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.chap_username = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.disk_geometry = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.driver_client_cert = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.driver_client_cert_key = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.driver_data_namespace = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.driver_use_ssl = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.extra_capabilities = {} {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.filter_function = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.goodness_function = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.iscsi_target_flags = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.iscsi_write_cache = on {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.iser_helper = tgtadm {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.iser_port = 3260 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.lvm_share_target = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.lvm_type = auto {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.num_shell_tries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.replication_device = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.report_discard_supported = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.reserved_percentage = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.target_helper = tgtadm {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.target_port = 3260 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.target_protocol = iscsi {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.trace_flags = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.unique_fqdn_network = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.use_chap_auth = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_backend_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_clear = zero {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_clear_ionice = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_clear_size = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_reports.file_event_handler = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_reports.log_dir = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.backend_host = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.chap_password = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.chap_username = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.disk_geometry = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.driver_client_cert = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.extra_capabilities = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.filter_function = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.goodness_function = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.iser_helper = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.iser_ip_address = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.iser_port = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.lvm_share_target = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.lvm_type = auto {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.num_shell_tries = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.replication_device = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.report_discard_supported = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.reserved_percentage = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.scst_target_driver = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.storage_protocol = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.target_helper = lioadm {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.target_ip_address = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.target_port = 3260 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.trace_flags = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.use_chap_auth = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_clear = zero {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_clear_size = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] lvmdriver-1.volumes_dir = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.ssl = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_notifications.driver = [] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_notifications.retry = -1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] key_manager.fixed_key = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.barbican_api_version = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.barbican_endpoint = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.barbican_endpoint_type = public {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.barbican_region_name = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.cafile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.collect_timing = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.insecure = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.number_of_retries = 60 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.retry_delay = 1 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.send_service_user_token = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.split_loggers = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.verify_ssl = True {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican.verify_ssl_path = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.auth_section = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.auth_type = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.cafile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.certfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.collect_timing = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.insecure = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.keyfile = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.split_loggers = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] barbican_service_user.timeout = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.approle_role_id = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.approle_secret_id = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.kv_mountpoint = secret {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.kv_path = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.kv_version = 2 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.namespace = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.root_token_id = **** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.ssl_ca_crt_file = None {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.timeout = 60.0 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.use_ssl = False {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:22:48 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] ******************************************************************************** {{(pid=72227) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:48 devstack sudo[72342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 02 10:22:48 devstack sudo[72342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:48 devstack sudo[72342]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:48 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:48 devstack sudo[72497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:48 devstack sudo[72497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:49 devstack sudo[72497]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:49 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.550s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:49 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:22:49 devstack cinder-volume[72337]: INFO cinder.brick.local_dev.lvm [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 02 10:22:49 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:49 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:49 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:49 devstack sudo[72734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:22:49 devstack sudo[72734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:50 devstack sudo[72734]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG cinder.brick.local_dev.lvm [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72337) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:50 devstack sudo[72868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:50 devstack sudo[72868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:50 devstack sudo[72868]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.837s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:50 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:50 devstack sudo[73034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:50 devstack sudo[73034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:51 devstack sudo[73034]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:51 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:51 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:51 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:51 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:51 devstack sudo[73041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 02 10:22:51 devstack sudo[73041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:51 devstack sudo[73041]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:51 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.434s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:51 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:51 devstack sudo[73044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:22:51 devstack sudo[73044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:52 devstack sudo[73044]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:52 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:52 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:52 devstack sudo[73049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:22:52 devstack sudo[73049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:52 devstack sudo[73049]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:52 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:52 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:52 devstack sudo[73053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:22:52 devstack sudo[73053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:53 devstack sudo[73053]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:53 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:53 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:53 devstack sudo[73060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:53 devstack sudo[73060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:53 devstack sudo[73060]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:53 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:53 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:53 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:53 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:53 devstack sudo[73065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:53 devstack sudo[73065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:54 devstack sudo[73065]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:54 devstack cinder-volume[72337]: INFO cinder.volume.drivers.lvm [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:54 devstack sudo[73185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:54 devstack sudo[73185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:54 devstack sudo[73185]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.529s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG cinder.volume.drivers.lvm [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Updating volume stats {{(pid=72337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 10:22:54 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:54 devstack sudo[73270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:22:54 devstack sudo[73270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:55 devstack sudo[73270]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:55 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:55 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:55 devstack sudo[73330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:22:55 devstack sudo[73330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:55 devstack sudo[73330]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:55 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:55 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:55 devstack sudo[73333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:55 devstack sudo[73333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:56 devstack sudo[73333]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:56 devstack sudo[73337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:22:56 devstack sudo[73337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:56 devstack sudo[73337]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:56 devstack cinder-volume[72337]: INFO cinder.volume.driver [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Driver hasn't implemented _init_vendor_properties() Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG cinder.volume.driver [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72337) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG oslo_db.sqlalchemy.engines [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG dbcounter [-] [72337] Writer thread running {{(pid=72337) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG cinder.db.sqlalchemy.api [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Building query based on filter {{(pid=72337) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG cinder.image.image_utils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72337) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 10:22:56 devstack cinder-volume[72337]: INFO cinder.keymgr.migration [None req-b3b5ba01-1c23-495b-b485-ccfbdd1c529b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG cinder.volume.drivers.lvm [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Updating volume stats {{(pid=72337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 10:22:56 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:56 devstack sudo[73344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:22:56 devstack sudo[73344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:57 devstack sudo[73344]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:57 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:57 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:57 devstack sudo[73347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:22:57 devstack sudo[73347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:57 devstack sudo[73347]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:57 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:57 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:57 devstack sudo[73352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:57 devstack sudo[73352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:58 devstack cinder-volume[72227]: DEBUG dbcounter [-] [72227] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72227) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:22:58 devstack sudo[73352]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:58 devstack sudo[73356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:22:58 devstack sudo[73356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:58 devstack sudo[73356]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG cinder.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Notifying Schedulers of capabilities ... {{(pid=72337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:22:58 devstack cinder-volume[72337]: INFO cinder.volume.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Driver initialization completed successfully. Apr 02 10:22:58 devstack cinder-volume[72337]: INFO cinder.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Initiating service 2 cleanup Apr 02 10:22:58 devstack cinder-volume[72337]: INFO cinder.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Service 2 cleanup completed. Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG cinder.service [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Creating RPC server for service cinder-volume {{(pid=72337) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG cinder.service [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72337) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 10:22:58 devstack cinder-volume[72337]: INFO cinder.volume.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG cinder.volume.drivers.lvm [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Updating volume stats {{(pid=72337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 10:22:58 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:58 devstack sudo[73361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:22:58 devstack sudo[73361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:59 devstack sudo[73361]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:59 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:59 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:59 devstack sudo[73367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:22:59 devstack sudo[73367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:59 devstack sudo[73367]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:59 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:59 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:22:59 devstack sudo[73425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:22:59 devstack sudo[73425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:22:59 devstack sudo[73425]: pam_unix(sudo:session): session closed for user root Apr 02 10:22:59 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.414s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:22:59 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:23:00 devstack sudo[73428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:23:00 devstack sudo[73428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:23:00 devstack sudo[73428]: pam_unix(sudo:session): session closed for user root Apr 02 10:23:00 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:23:00 devstack cinder-volume[72337]: INFO cinder.volume.manager [None req-0aa5b16d-eebe-439a-b2c3-835616d8f30b None None] Driver post RPC initialization completed successfully. Apr 02 10:23:10 devstack cinder-volume[72337]: DEBUG dbcounter [-] [72337] Writing DB stats cinder:SELECT=4 {{(pid=72337) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:23:10 devstack cinder-volume[72337]: DEBUG dbcounter [-] [72337] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72337) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:24:03 devstack cinder-volume[72337]: DEBUG oslo_service.periodic_task [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:24:03 devstack cinder-volume[72337]: DEBUG cinder.volume.drivers.lvm [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Updating volume stats {{(pid=72337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 10:24:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:24:03 devstack sudo[78161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:24:03 devstack sudo[78161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:24:03 devstack sudo[78161]: pam_unix(sudo:session): session closed for user root Apr 02 10:24:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:24:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:24:03 devstack sudo[78164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:24:03 devstack sudo[78164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:24:04 devstack sudo[78164]: pam_unix(sudo:session): session closed for user root Apr 02 10:24:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:24:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:24:04 devstack sudo[78167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:24:04 devstack sudo[78167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:24:04 devstack sudo[78167]: pam_unix(sudo:session): session closed for user root Apr 02 10:24:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:24:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:24:04 devstack sudo[78170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:24:04 devstack sudo[78170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:24:05 devstack sudo[78170]: pam_unix(sudo:session): session closed for user root Apr 02 10:24:05 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:24:05 devstack cinder-volume[72337]: DEBUG cinder.manager [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Notifying Schedulers of capabilities ... {{(pid=72337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:25:03 devstack cinder-volume[72337]: DEBUG oslo_service.periodic_task [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:25:03 devstack cinder-volume[72337]: DEBUG cinder.volume.drivers.lvm [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Updating volume stats {{(pid=72337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 10:25:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:25:03 devstack sudo[79412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:25:03 devstack sudo[79412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:25:03 devstack sudo[79412]: pam_unix(sudo:session): session closed for user root Apr 02 10:25:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:25:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:25:03 devstack sudo[79455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:25:03 devstack sudo[79455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:25:04 devstack sudo[79455]: pam_unix(sudo:session): session closed for user root Apr 02 10:25:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:25:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:25:04 devstack sudo[79469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:25:04 devstack sudo[79469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:25:04 devstack sudo[79469]: pam_unix(sudo:session): session closed for user root Apr 02 10:25:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:25:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:25:04 devstack sudo[79494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:25:04 devstack sudo[79494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:25:05 devstack sudo[79494]: pam_unix(sudo:session): session closed for user root Apr 02 10:25:05 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:25:05 devstack cinder-volume[72337]: DEBUG cinder.manager [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Notifying Schedulers of capabilities ... {{(pid=72337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:25:10 devstack cinder-volume[72337]: DEBUG dbcounter [-] [72337] Writing DB stats cinder:SELECT=1 {{(pid=72337) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:25:10 devstack cinder-volume[72337]: DEBUG dbcounter [-] [72337] Writing DB stats cinder:UPDATE=1 {{(pid=72337) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:26:03 devstack cinder-volume[72337]: DEBUG oslo_service.periodic_task [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:26:03 devstack cinder-volume[72337]: DEBUG cinder.volume.drivers.lvm [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Updating volume stats {{(pid=72337) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 02 10:26:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:03 devstack sudo[81128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 02 10:26:03 devstack sudo[81128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:03 devstack sudo[81128]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:03 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:03 devstack sudo[81131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:26:03 devstack sudo[81131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:04 devstack sudo[81131]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:04 devstack sudo[81157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 02 10:26:04 devstack sudo[81157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:04 devstack sudo[81157]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:04 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:04 devstack sudo[81163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 02 10:26:04 devstack sudo[81163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:05 devstack sudo[81163]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:05 devstack cinder-volume[72337]: DEBUG oslo_concurrency.processutils [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:05 devstack cinder-volume[72337]: DEBUG cinder.manager [None req-1fe9b6e2-585c-460d-a98d-fb3f836473e0 None None] Notifying Schedulers of capabilities ... {{(pid=72337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:26:32 devstack cinder-volume[72227]: INFO oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Caught SIGTERM, stopping children Apr 02 10:26:32 devstack cinder-volume[72227]: DEBUG oslo_concurrency.lockutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Acquiring lock "singleton_lock" {{(pid=72227) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:26:32 devstack cinder-volume[72227]: DEBUG oslo_concurrency.lockutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Acquired lock "singleton_lock" {{(pid=72227) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:26:32 devstack cinder-volume[72227]: DEBUG oslo_concurrency.lockutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Releasing lock "singleton_lock" {{(pid=72227) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:26:32 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Stop services. {{(pid=72227) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 02 10:26:32 devstack cinder-volume[72227]: DEBUG oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Killing children. {{(pid=72227) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 02 10:26:32 devstack cinder-volume[72227]: INFO oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Waiting on 1 children to exit Apr 02 10:26:33 devstack cinder-volume[72337]: DEBUG oslo_concurrency.lockutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Acquiring lock "singleton_lock" {{(pid=72337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:26:33 devstack cinder-volume[72337]: DEBUG oslo_concurrency.lockutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Acquired lock "singleton_lock" {{(pid=72337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:26:33 devstack cinder-volume[72337]: DEBUG oslo_concurrency.lockutils [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Releasing lock "singleton_lock" {{(pid=72337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:26:33 devstack cinder-volume[72337]: WARNING amqp [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 10:26:33 devstack cinder-volume[72337]: WARNING amqp [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 10:26:33 devstack cinder-volume[72227]: INFO oslo_service.backend._eventlet.service [None req-2876dbd3-4ab9-4199-b82e-f1aede721d76 None None] Child 72337 exited with status 0 Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81823) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81823) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81823) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:26:36 devstack cinder-volume[81823]: INFO dbcounter [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Registered counter for database cinder Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG oslo_db.sqlalchemy.engines [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG dbcounter [-] [81823] Writer thread running {{(pid=81823) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 10:26:36 devstack cinder-volume[81823]: INFO cinder.rpc [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 10:26:36 devstack cinder-volume[81823]: INFO cinder.rpc [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG oslo_db.sqlalchemy.engines [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:36 devstack cinder-volume[81823]: INFO cinder.volume.manager [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Determined volume DB was empty at startup. Apr 02 10:26:36 devstack cinder-volume[81823]: DEBUG cinder.volume.manager [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81823) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 10:26:37 devstack cinder-volume[81823]: INFO cinder.volume.manager [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 02 10:26:37 devstack cinder-volume[81823]: WARNING stevedore.named [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 10:26:37 devstack cinder-volume[81823]: WARNING castellan.key_manager [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:26:37 devstack cinder-volume[81823]: WARNING cinder.keymgr.conf_key_mgr [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:26:37 devstack cinder-volume[81823]: INFO cinder.volume.manager [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_db.sqlalchemy.engines [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81823) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:37 devstack cinder-volume[81823]: INFO oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Starting 1 workers Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Started child 81941 {{(pid=81823) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Full set of CONF: {{(pid=81823) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] ******************************************************************************** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Configuration options gathered from: {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] ================================================================================ {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] allow_availability_zone_fallback = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] allow_compression_on_image_upload = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] allowed_direct_url_schemes = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] api_rate_limit = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] auth_strategy = keystone {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_availability_zone = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_host = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_stats_polling_interval = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backup_api_class = cinder.backup.api.API {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backup_name_template = backup-%s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backup_use_same_host = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backup_use_temp_snapshot = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] chap_password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] chap_username = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81941]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_internal_tenant_project_id = b29dedab6383443f802ddd0d4be8a62d {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_internal_tenant_user_id = d8f3f91229bc47488b51939bab4c4dda {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cluster = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] compression_format = gzip {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] compute_api_class = cinder.compute.nova.API {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] config_dir = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] config_source = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] control_exchange = openstack {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] debug = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] default_availability_zone = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] default_group_type = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] default_volume_type = QuobyteHD {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] disk_geometry = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] driver_client_cert = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] driver_client_cert_key = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] driver_data_namespace = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] driver_ssl_cert_path = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] driver_ssl_cert_verify = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] driver_use_ssl = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] enable_new_services = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] enable_unsupported_driver = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] enabled_backends = ['QuobyteHD'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] enforce_multipath_for_image_xfer = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] filter_function = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_api_insecure = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_api_ssl_compression = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_ca_certificates_file = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_catalog_info = image:glance:publicURL {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_num_retries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance_request_timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] goodness_function = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] graceful_shutdown_timeout = 5 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] group_api_class = cinder.group.api.API {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] host = devstack {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_compress_on_upload = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_conversion_address_space_limit = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_conversion_cpu_limit = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_conversion_disable = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_upload_use_cinder_backend = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_upload_use_internal_tenant = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_volume_cache_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_volume_cache_max_count = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] image_volume_cache_max_size_gb = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] init_host_max_objects_retrieval = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] instance_format = [instance: %(uuid)s] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] iscsi_target_flags = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] iscsi_write_cache = on {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] iser_helper = tgtadm {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] iser_ip_address = 192.168.122.149 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] iser_port = 3260 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_color = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_config_append = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_dir = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_file = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_options = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_rotate_interval = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_rotate_interval_type = days {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] log_rotation_type = none {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] max_age = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] max_logfile_count = 30 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] max_logfile_size_mb = 200 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] max_over_subscription_ratio = 20.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] message_reap_interval = 86400 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] message_ttl = 2592000 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] migration_create_volume_timeout_secs = 300 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] monkey_patch = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] monkey_patch_modules = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] my_ip = 192.168.122.149 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] no_snapshot_gb_quota = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] num_iser_scan_tries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] num_shell_tries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] num_volume_device_scan_tries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] nvmeof_conn_info_version = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] nvmet_ns_id = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] nvmet_port_id = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_max_limit = 1000 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_volume_ext_list = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_volume_listen_port = 8776 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_volume_use_ssl = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] osapi_volume_workers = 2 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] per_volume_size_limit = -1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] periodic_fuzzy_delay = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] periodic_interval = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] public_endpoint = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] publish_errors = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_backup_gigabytes = 1000 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_backups = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_gigabytes = 1000 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_groups = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_snapshots = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] quota_volumes = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] rate_limit_burst = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] rate_limit_except_level = CRITICAL {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] rate_limit_interval = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] reinit_driver_count = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] replication_device = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] report_discard_supported = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] report_interval = 120 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] reservation_clean_interval = 86400 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] reservation_expire = 86400 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] reserved_image_namespaces = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] reserved_percentage = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] rpc_response_timeout = 120 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] run_external_periodic_tasks = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] scst_target_driver = iscsi {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] scst_target_iqn_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_down_time = 720 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] shell_completion = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] snapshot_name_template = snapshot-%s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] split_loggers = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] state_path = /opt/stack/data/cinder {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] storage_availability_zone = nova {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] storage_protocol = iSCSI {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] syslog_log_facility = LOG_USER {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] target_helper = lioadm {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] target_ip_address = 192.168.122.149 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] target_port = 3260 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] target_protocol = iscsi {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] target_secondary_ip_addresses = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] trace_flags = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] transport_url = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] until_refresh = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_chap_auth = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_default_quota_class = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_journal = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_json = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_multipath_for_image_xfer = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_stderr = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] use_syslog = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] verify_glance_signatures = enabled {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_api_class = cinder.volume.api.API {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_backend_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_clear = zero {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_clear_ionice = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_clear_size = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_copy_bps_limit = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_dd_blocksize = 1M {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_name_template = volume-%s {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_service_inithost_offload = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volume_usage_audit_period = month {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] zoning_mode = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_concurrency.disable_process_locking = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.admin_password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.admin_token = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.admin_user = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_port = 35357 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_protocol = https {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_section = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_type = password {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_uri = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.auth_version = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.cache = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.identity_uri = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.include_service_catalog = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.insecure = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.interface = public {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_password = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcache_username = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.region_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.service_type = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.remotefs [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81941) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.backend = dogpile.cache.null {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.backend_argument = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.backend_expiration_time = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.config_prefix = cache.oslo {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.debug_cache_backend = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.enable_retry_client = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.enable_socket_keepalive = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.enforce_fips_mode = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.expiration_time = 600 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.hashclient_retry_attempts = 2 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_dead_retry = 300 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_pool_maxsize = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_sasl_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.proxies = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.redis_db = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.redis_server = localhost:6379 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.retry_attempts = 2 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.retry_delay = 0.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.socket_keepalive_count = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.socket_keepalive_idle = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.socket_keepalive_interval = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.socket_timeout = 1.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.tls_allowed_ciphers = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.tls_cafile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.tls_certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.tls_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.tls_keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cache.username = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] coordination.backend_url = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.asyncio_connection = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.asyncio_slave_connection = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.backend = sqlalchemy {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.connection = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.connection_debug = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.connection_parameters = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.connection_recycle_time = 3600 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.connection_trace = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.db_inc_retry_interval = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.db_max_retries = 20 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.db_max_retry_interval = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.db_retry_interval = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.max_overflow = 50 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.max_pool_size = 5 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.max_retries = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.mysql_wsrep_sync_wait = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.pool_timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.retry_interval = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.slave_connection = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.sqlite_synchronous = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.synchronous_reader = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] database.use_db_reconnect = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.connection_string = messaging:// {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.es_doc_type = notification {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.es_scroll_size = 10000 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.es_scroll_time = 2m {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.filter_error_trace = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.hmac_keys = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.sentinel_service_name = mymaster {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.socket_timeout = 0.1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.trace_requests = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler.trace_sqlalchemy = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler_jaeger.process_tags = {} {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler_jaeger.service_name_prefix = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] profiler_otlp.service_name_prefix = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.enforce_new_defaults = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: WARNING oslo_config.cfg [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.enforce_scope = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.policy_default_rule = default {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.policy_file = policy.yaml {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.group = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.helper_command = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] privsep_osbrick.user = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.group = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.helper_command = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] cinder_sys_admin.user = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.auth_section = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.auth_type = password {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.cafile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.collect_timing = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.insecure = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.send_service_user_token = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.split_loggers = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] service_user.timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.auth_section = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.auth_type = password {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.collect_timing = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.insecure = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.region_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.split_loggers = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] glance.timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.backend_availability_zone = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.chap_password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.chap_username = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.disk_geometry = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.driver_client_cert = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.driver_client_cert_key = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.driver_data_namespace = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.driver_use_ssl = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.extra_capabilities = {} {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.filter_function = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.goodness_function = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.iscsi_target_flags = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.iscsi_write_cache = on {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.iser_helper = tgtadm {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.iser_port = 3260 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_host = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_login = admin {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_mount_options = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_private_key = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_share_path = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.num_shell_tries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.quobyte_volume_url = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.replication_device = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.report_discard_supported = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.reserved_percentage = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.target_helper = tgtadm {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.target_port = 3260 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.target_protocol = iscsi {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.trace_flags = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.unique_fqdn_network = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.use_chap_auth = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_backend_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_clear = zero {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_clear_ionice = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_clear_size = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_reports.file_event_handler = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_reports.log_dir = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.backend_availability_zone = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.backend_host = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.chap_password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.chap_username = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.chiscsi_conf = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.disk_geometry = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.driver_client_cert = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.driver_data_namespace = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.driver_use_ssl = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.extra_capabilities = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.filter_function = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.goodness_function = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.iser_helper = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.iser_ip_address = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.iser_port = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.iser_target_prefix = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_host = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_login = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_mount_options = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_password = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_private_key = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_share_path = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_ssh_port = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.num_shell_tries = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.nvmet_port_id = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.replication_device = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.report_discard_supported = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.reserved_percentage = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.scst_target_driver = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.storage_protocol = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.target_helper = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.target_ip_address = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.target_port = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.target_prefix = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.target_protocol = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.trace_flags = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.use_chap_auth = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_clear = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_clear_size = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] QuobyteHD.volumes_dir = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.ssl = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_notifications.driver = [] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_notifications.retry = -1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] key_manager.fixed_key = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.barbican_api_version = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.barbican_endpoint = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.barbican_endpoint_type = public {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.barbican_region_name = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.cafile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.collect_timing = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.insecure = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.number_of_retries = 60 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.retry_delay = 1 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.send_service_user_token = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.split_loggers = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.verify_ssl = True {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican.verify_ssl_path = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.auth_section = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.auth_type = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.cafile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.certfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.collect_timing = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.insecure = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.keyfile = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.split_loggers = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] barbican_service_user.timeout = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.approle_role_id = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.approle_secret_id = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.kv_mountpoint = secret {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.kv_path = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.kv_version = 2 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.namespace = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.root_token_id = **** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.ssl_ca_crt_file = None {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.timeout = 60.0 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.use_ssl = False {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:37 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] ******************************************************************************** {{(pid=81823) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81941) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 02 10:26:37 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 02 10:26:37 devstack cinder-volume[81941]: WARNING cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Running cmd (subprocess): mount.quobyte {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:37 devstack quobyte-client[81942]: Reading configuration file: /etc/quobyte/client.cfg Apr 02 10:26:37 devstack quobyte-client[81942]: Invalid parameters found, error: missing mount point. Apr 02 10:26:37 devstack quobyte-client[81942]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 02 10:26:37 devstack quobyte-client[81942]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:37 devstack cinder-volume[81941]: INFO cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 ... Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 -c /etc/quobyte/client-cinder.cfg {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:37 devstack sudo[81943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 -c /etc/quobyte/client-cinder.cfg Apr 02 10:26:37 devstack sudo[81943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:37 devstack sudo[81943]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.500s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:37 devstack cinder-volume[81941]: INFO cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 succeeded Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.509s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:37 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:37 devstack sudo[82012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:37 devstack sudo[82012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:38 devstack sudo[82012]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.461s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:38 devstack cinder-volume[81941]: INFO cinder.volume.driver [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Driver hasn't implemented _init_vendor_properties() Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.driver [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7462348937988, 'free_capacity_gb': 1775.7462348937988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81941) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_db.sqlalchemy.engines [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG dbcounter [-] [81941] Writer thread running {{(pid=81941) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.db.sqlalchemy.api [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Building query based on filter {{(pid=81941) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.image.image_utils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81941) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 10:26:38 devstack cinder-volume[81941]: INFO cinder.keymgr.migration [None req-4ab1d0e6-9b35-4c6b-b1f2-024ed19034a0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:38 devstack sudo[82015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:38 devstack sudo[82015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:38 devstack sudo[82015]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.462s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:26:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Driver initialization completed successfully. Apr 02 10:26:38 devstack cinder-volume[81941]: INFO cinder.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Initiating service 3 cleanup Apr 02 10:26:38 devstack cinder-volume[81941]: INFO cinder.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Service 3 cleanup completed. Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.service [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Creating RPC server for service cinder-volume {{(pid=81941) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.service [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81941) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 10:26:38 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:38 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:39 devstack sudo[82022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:39 devstack sudo[82022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:39 devstack sudo[82022]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:39 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.570s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:39 devstack cinder-volume[81941]: INFO cinder.volume.manager [None req-8f13235d-fc63-4fe4-83fd-40ba50186904 None None] Driver post RPC initialization completed successfully. Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=81941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG cinder.volume.drivers.quobyte [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=81941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81941) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:42 devstack sudo[82091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:42 devstack sudo[82091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:42 devstack sudo[82091]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG oslo_concurrency.processutils [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.492s {{(pid=81941) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:42 devstack cinder-volume[81941]: DEBUG cinder.manager [None req-945fe92a-ef88-4640-801d-6d0764257854 None None] Notifying Schedulers of capabilities ... {{(pid=81941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:26:46 devstack cinder-volume[81823]: INFO oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Caught SIGTERM, stopping children Apr 02 10:26:46 devstack cinder-volume[81823]: DEBUG oslo_concurrency.lockutils [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Acquiring lock "singleton_lock" {{(pid=81823) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:26:46 devstack cinder-volume[81823]: DEBUG oslo_concurrency.lockutils [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Acquired lock "singleton_lock" {{(pid=81823) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:26:46 devstack cinder-volume[81823]: DEBUG oslo_concurrency.lockutils [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Releasing lock "singleton_lock" {{(pid=81823) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:26:46 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Stop services. {{(pid=81823) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 02 10:26:46 devstack cinder-volume[81823]: DEBUG oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Killing children. {{(pid=81823) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 02 10:26:46 devstack cinder-volume[81823]: INFO oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Waiting on 1 children to exit Apr 02 10:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Acquiring lock "singleton_lock" {{(pid=81941) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Acquired lock "singleton_lock" {{(pid=81941) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:26:47 devstack cinder-volume[81941]: DEBUG oslo_concurrency.lockutils [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Releasing lock "singleton_lock" {{(pid=81941) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:26:47 devstack cinder-volume[81941]: WARNING amqp [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 10:26:47 devstack cinder-volume[81941]: WARNING amqp [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 02 10:26:47 devstack cinder-volume[81823]: INFO oslo_service.backend._eventlet.service [None req-977c5795-c6df-4479-a80d-4a5b0c0bda8a None None] Child 81941 exited with status 0 Apr 02 10:26:49 devstack cinder-volume[82169]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82169) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 02 10:26:49 devstack cinder-volume[82169]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82169) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 02 10:26:49 devstack cinder-volume[82169]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82169) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 02 10:26:50 devstack cinder-volume[82169]: INFO dbcounter [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Registered counter for database cinder Apr 02 10:26:50 devstack cinder-volume[82169]: DEBUG oslo_db.sqlalchemy.engines [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG dbcounter [-] [82169] Writer thread running {{(pid=82169) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 10:26:51 devstack cinder-volume[82169]: INFO cinder.rpc [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 02 10:26:51 devstack cinder-volume[82169]: INFO cinder.rpc [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_db.sqlalchemy.engines [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:51 devstack cinder-volume[82169]: INFO cinder.volume.manager [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Determined volume DB was empty at startup. Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG cinder.volume.manager [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82169) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 02 10:26:51 devstack cinder-volume[82169]: WARNING stevedore.named [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 02 10:26:51 devstack cinder-volume[82169]: WARNING castellan.key_manager [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:26:51 devstack cinder-volume[82169]: WARNING cinder.keymgr.conf_key_mgr [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 02 10:26:51 devstack cinder-volume[82169]: INFO cinder.volume.manager [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_db.sqlalchemy.engines [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:51 devstack cinder-volume[82169]: INFO oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Starting 1 workers Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Started child 82391 {{(pid=82169) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Full set of CONF: {{(pid=82169) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] ******************************************************************************** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Configuration options gathered from: {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] ================================================================================ {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] allow_availability_zone_fallback = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] allow_compression_on_image_upload = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] allowed_direct_url_schemes = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] api_rate_limit = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] auth_strategy = keystone {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_availability_zone = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_host = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_stats_polling_interval = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backup_api_class = cinder.backup.api.API {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backup_name_template = backup-%s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backup_use_same_host = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backup_use_temp_snapshot = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] chap_password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] chap_username = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_internal_tenant_project_id = b29dedab6383443f802ddd0d4be8a62d {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_internal_tenant_user_id = d8f3f91229bc47488b51939bab4c4dda {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cluster = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] compression_format = gzip {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] compute_api_class = cinder.compute.nova.API {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] config_dir = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] config_source = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] control_exchange = openstack {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] debug = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] default_availability_zone = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] default_group_type = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82391]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] default_volume_type = QuobyteHD {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] disk_geometry = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] driver_client_cert = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] driver_client_cert_key = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] driver_data_namespace = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] driver_ssl_cert_path = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] driver_ssl_cert_verify = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] driver_use_ssl = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] enable_new_services = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] enable_unsupported_driver = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] enabled_backends = ['QuobyteHD'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] enforce_multipath_for_image_xfer = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] filter_function = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_api_insecure = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_api_servers = ['http://192.168.122.149/image'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_api_ssl_compression = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_ca_certificates_file = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_catalog_info = image:glance:publicURL {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_num_retries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance_request_timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] goodness_function = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] graceful_shutdown_timeout = 5 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] group_api_class = cinder.group.api.API {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] host = devstack {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_compress_on_upload = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_conversion_address_space_limit = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_conversion_cpu_limit = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_conversion_disable = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_upload_use_cinder_backend = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_upload_use_internal_tenant = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_volume_cache_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_volume_cache_max_count = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] image_volume_cache_max_size_gb = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] init_host_max_objects_retrieval = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] instance_format = [instance: %(uuid)s] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] iscsi_target_flags = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] iscsi_write_cache = on {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] iser_helper = tgtadm {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] iser_ip_address = 192.168.122.149 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] iser_port = 3260 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_color = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_config_append = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_dir = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_file = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_options = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_rotate_interval = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_rotate_interval_type = days {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] log_rotation_type = none {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] max_age = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] max_logfile_count = 30 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] max_logfile_size_mb = 200 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] max_over_subscription_ratio = 20.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] message_reap_interval = 86400 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] message_ttl = 2592000 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] migration_create_volume_timeout_secs = 300 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] monkey_patch = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] monkey_patch_modules = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] my_ip = 192.168.122.149 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] no_snapshot_gb_quota = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] num_iser_scan_tries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] num_shell_tries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] num_volume_device_scan_tries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] nvmeof_conn_info_version = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] nvmet_ns_id = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] nvmet_port_id = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_max_limit = 1000 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_volume_ext_list = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_volume_listen = 0.0.0.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_volume_listen_port = 8776 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_volume_use_ssl = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] osapi_volume_workers = 2 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] per_volume_size_limit = -1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] periodic_fuzzy_delay = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] periodic_interval = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] project_id_regex = [0-9a-f\-]+ {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] public_endpoint = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] publish_errors = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_backup_gigabytes = 1000 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_backups = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_gigabytes = 1000 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_groups = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_snapshots = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] quota_volumes = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] rate_limit_burst = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] rate_limit_except_level = CRITICAL {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] rate_limit_interval = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] reinit_driver_count = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] replication_device = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] report_discard_supported = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] report_interval = 120 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] reservation_clean_interval = 86400 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] reservation_expire = 86400 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] reserved_image_namespaces = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] reserved_percentage = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] rpc_response_timeout = 120 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] run_external_periodic_tasks = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] scst_target_driver = iscsi {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] scst_target_iqn_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_down_time = 720 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] shell_completion = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] snapshot_name_template = snapshot-%s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] split_loggers = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] state_path = /opt/stack/data/cinder {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] storage_availability_zone = nova {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] storage_protocol = iSCSI {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] syslog_log_facility = LOG_USER {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] target_helper = lioadm {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] target_ip_address = 192.168.122.149 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] target_port = 3260 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] target_protocol = iscsi {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] target_secondary_ip_addresses = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] trace_flags = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] transfer_api_class = cinder.transfer.api.API {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] transport_url = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] until_refresh = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_chap_auth = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_default_quota_class = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_journal = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_json = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_multipath_for_image_xfer = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_stderr = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] use_syslog = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] verify_glance_signatures = enabled {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_api_class = cinder.volume.api.API {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_backend_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_clear = zero {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_clear_ionice = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_clear_size = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_copy_bps_limit = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_dd_blocksize = 1M {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_name_template = volume-%s {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_service_inithost_offload = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volume_usage_audit_period = month {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] zoning_mode = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_concurrency.disable_process_locking = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.admin_password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.admin_token = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.admin_user = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_admin_prefix = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_port = 35357 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_protocol = https {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_section = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_type = password {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_uri = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.auth_version = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.cache = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82391) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.delay_auth_decision = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.http_connect_timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.identity_uri = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.include_service_catalog = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.insecure = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.interface = public {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_password = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcache_username = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.region_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.service_token_roles_required = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.service_type = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.token_cache_time = 300 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.149/identity {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.backend = dogpile.cache.null {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.backend_argument = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.backend_expiration_time = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.config_prefix = cache.oslo {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.debug_cache_backend = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.enable_retry_client = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.enable_socket_keepalive = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.enforce_fips_mode = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.expiration_time = 600 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.hashclient_retry_attempts = 2 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_dead_retry = 300 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_pool_maxsize = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_sasl_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.proxies = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.redis_db = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.redis_sentinel_service_name = mymaster {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.redis_server = localhost:6379 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.retry_attempts = 2 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.retry_delay = 0.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.socket_keepalive_count = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.socket_keepalive_idle = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.socket_keepalive_interval = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.socket_timeout = 1.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.tls_allowed_ciphers = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.tls_cafile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.tls_certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.tls_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.tls_keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cache.username = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] coordination.backend_url = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.asyncio_connection = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.asyncio_slave_connection = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.backend = sqlalchemy {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.connection = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.connection_debug = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.connection_parameters = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.connection_recycle_time = 3600 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.connection_trace = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.db_inc_retry_interval = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.db_max_retries = 20 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.db_max_retry_interval = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.db_retry_interval = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.max_overflow = 50 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.max_pool_size = 5 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.max_retries = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.mysql_wsrep_sync_wait = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.pool_timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.retry_interval = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.slave_connection = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.sqlite_synchronous = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.synchronous_reader = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] database.use_db_reconnect = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.connection_string = messaging:// {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.es_doc_type = notification {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.es_scroll_size = 10000 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.es_scroll_time = 2m {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.filter_error_trace = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.hmac_keys = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.sentinel_service_name = mymaster {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.socket_timeout = 0.1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.trace_requests = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler.trace_sqlalchemy = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler_jaeger.process_tags = {} {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler_jaeger.service_name_prefix = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] profiler_otlp.service_name_prefix = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.enforce_new_defaults = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: WARNING oslo_config.cfg [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.enforce_scope = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.policy_default_rule = default {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.policy_file = policy.yaml {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_policy.remote_timeout = 60.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.group = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.helper_command = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] privsep_osbrick.user = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.group = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.helper_command = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] cinder_sys_admin.user = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.auth_section = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.auth_type = password {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.cafile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.collect_timing = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.insecure = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.send_service_user_token = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.split_loggers = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] service_user.timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.auth_section = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.auth_type = password {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.collect_timing = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.insecure = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.region_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.split_loggers = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] glance.timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.backend_availability_zone = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.chap_password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.chap_username = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.disk_geometry = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.driver_client_cert = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.driver_client_cert_key = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.driver_data_namespace = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.driver_use_ssl = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.enable_unsupported_driver = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.extra_capabilities = {} {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.filter_function = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.goodness_function = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.iscsi_target_flags = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.iscsi_write_cache = on {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.iser_helper = tgtadm {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.iser_ip_address = 192.168.122.149 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.iser_port = 3260 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_host = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_login = admin {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_mount_options = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_private_key = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_share_path = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_ssh_port = 22 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.num_shell_tries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.nvmet_port_id = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_client_cfg = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.quobyte_volume_url = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.replication_device = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.report_discard_supported = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.reserved_percentage = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.scst_target_driver = iscsi {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.scst_target_iqn_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.storage_protocol = iSCSI {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.target_helper = tgtadm {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.target_ip_address = 192.168.122.149 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.target_port = 3260 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.target_protocol = iscsi {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.trace_flags = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.unique_fqdn_network = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.use_chap_auth = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_backend_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_clear = zero {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_clear_ionice = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_clear_size = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_reports.file_event_handler = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_reports.log_dir = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.backend_availability_zone = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.backend_host = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.chap_password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.chap_username = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.chiscsi_conf = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.disk_geometry = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.driver_client_cert = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.driver_client_cert_key = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.driver_data_namespace = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.driver_use_ssl = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.extra_capabilities = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.filter_function = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.goodness_function = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.iscsi_target_flags = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.iscsi_write_cache = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.iser_helper = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.iser_ip_address = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.iser_port = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.iser_target_prefix = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_host = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_login = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_mount_options = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_password = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_private_key = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_share_path = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_ssh_port = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.num_shell_tries = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nvmet_ns_id = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.nvmet_port_id = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.replication_device = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.report_discard_supported = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.reserved_percentage = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.scst_target_driver = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.storage_protocol = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82391) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.target_helper = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.target_ip_address = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.target_port = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.target_prefix = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.target_protocol = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.trace_flags = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.unique_fqdn_network = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.use_chap_auth = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_clear = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_clear_ionice = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_clear_size = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] QuobyteHD.volumes_dir = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Running cmd (subprocess): mount.quobyte {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.ssl = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.ssl_version = {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_notifications.driver = [] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_notifications.retry = -1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] key_manager.fixed_key = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.barbican_api_version = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.barbican_endpoint = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.barbican_endpoint_type = public {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.barbican_region_name = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.cafile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.collect_timing = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.insecure = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.number_of_retries = 60 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.retry_delay = 1 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.send_service_user_token = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.split_loggers = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.verify_ssl = True {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican.verify_ssl_path = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.auth_section = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.auth_type = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.cafile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.certfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.collect_timing = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.insecure = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.keyfile = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.split_loggers = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] barbican_service_user.timeout = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.approle_role_id = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.approle_secret_id = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.kv_mountpoint = secret {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.kv_path = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.kv_version = 2 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.namespace = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.root_token_id = **** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.ssl_ca_crt_file = None {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.timeout = 60.0 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.use_ssl = False {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 02 10:26:51 devstack cinder-volume[82169]: DEBUG oslo_service.backend._eventlet.service [None req-28cb62f7-3655-4ed3-9ec6-000e773e4f7d None None] ******************************************************************************** {{(pid=82169) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 02 10:26:51 devstack quobyte-client[82401]: Reading configuration file: /etc/quobyte/client.cfg Apr 02 10:26:51 devstack quobyte-client[82401]: Invalid parameters found, error: missing mount point. Apr 02 10:26:51 devstack quobyte-client[82401]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 02 10:26:51 devstack quobyte-client[82401]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:51 devstack sudo[82408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:51 devstack sudo[82408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:52 devstack sudo[82408]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.629s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:52 devstack cinder-volume[82391]: INFO cinder.volume.driver [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Driver hasn't implemented _init_vendor_properties() Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.volume.driver [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7462348937988, 'free_capacity_gb': 1775.7462348937988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82391) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writer thread running {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.db.sqlalchemy.api [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Building query based on filter {{(pid=82391) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82391) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:52 devstack cinder-volume[82391]: INFO cinder.keymgr.migration [None req-8069ed04-aa09-4478-a2ad-c2eb0d4cfe45 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 02 10:26:52 devstack sudo[82420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:52 devstack sudo[82420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:52 devstack sudo[82420]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.449s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:26:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Driver initialization completed successfully. Apr 02 10:26:52 devstack cinder-volume[82391]: INFO cinder.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Initiating service 3 cleanup Apr 02 10:26:52 devstack cinder-volume[82391]: INFO cinder.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Service 3 cleanup completed. Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.service [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Creating RPC server for service cinder-volume {{(pid=82391) start /opt/stack/cinder/cinder/service.py:231}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.service [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82391) start /opt/stack/cinder/cinder/service.py:237}} Apr 02 10:26:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:26:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:26:52 devstack sudo[82426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:26:52 devstack sudo[82426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:26:53 devstack sudo[82426]: pam_unix(sudo:session): session closed for user root Apr 02 10:26:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.474s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:26:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6f5a20e7-754b-4a3e-b328-12704a344f6a None None] Driver post RPC initialization completed successfully. Apr 02 10:27:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-224021dd-d862-4d61-a30e-7c58961831dd tempest-BackendsCapabilitiesAdminTestsJSON-1500252971 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7462348937988, 'free_capacity_gb': 1775.7462348937988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82391) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 02 10:27:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0d056d41-f72e-456d-813c-dd3f56a4cb6c tempest-BackendsCapabilitiesAdminTestsJSON-1500252971 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7462348937988, 'free_capacity_gb': 1775.7462348937988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82391) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 02 10:27:01 devstack cinder-volume[82169]: DEBUG dbcounter [-] [82169] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82169) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:27:02 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:27:03 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=3 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:27:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0291ee9b-e852-4fbd-bd85-cc81e1b149eb tempest-GroupsV314Test-2115699270 None] Group tempest-GroupsV314Test-Group-1568854971: creating Apr 02 10:27:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0291ee9b-e852-4fbd-bd85-cc81e1b149eb tempest-GroupsV314Test-2115699270 None] Group tempest-GroupsV314Test-Group-1568854971: created successfully Apr 02 10:27:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0291ee9b-e852-4fbd-bd85-cc81e1b149eb tempest-GroupsV314Test-2115699270 None] Create group completed successfully. Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Flow 'volume_create_manager' (b596b9d5-a0ba-4d1d-abb4-ee4f6ba2962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f36e539-c808-42c6-a0db-50bd3c2819e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f36e539-c808-42c6-a0db-50bd3c2819e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276445057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8992985d-cf93-433b-94c8-41a43b9a8c59,host='devstack@QuobyteHD#QuobyteHD',id=d067eb41-1ce9-47a4-8443-4e217a8e8478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c519ae7a7ec54db796b46cb1764a91f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:54Z,use_quota=True,user_id='1d277ac33ba241b089e3f5fdca1e77f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d48b1242-4161-42bf-b67b-d324fbbfcdb5),volume_type_id=d48b1242-4161-42bf-b67b-d324fbbfcdb5)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172159f9-d0e0-490d-b010-e49730f00e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172159f9-d0e0-490d-b010-e49730f00e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0409334-a7ab-4eb8-930a-28e5c2b4793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0409334-a7ab-4eb8-930a-28e5c2b4793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd067eb41-1ce9-47a4-8443-4e217a8e8478', 'volume_name': 'volume-d067eb41-1ce9-47a4-8443-4e217a8e8478', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76384d2-3387-43b8-b60e-0e28ba21ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76384d2-3387-43b8-b60e-0e28ba21ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ca5229-acad-44fd-aaec-04f0d89df43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:54 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Volume d067eb41-1ce9-47a4-8443-4e217a8e8478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d067eb41-1ce9-47a4-8443-4e217a8e8478', 'volume_size': 1} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8992985d-cf93-433b-94c8-41a43b9a8c59,created_at=2026-04-02T08:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276445057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8992985d-cf93-433b-94c8-41a43b9a8c59,host='devstack@QuobyteHD#QuobyteHD',id=d067eb41-1ce9-47a4-8443-4e217a8e8478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c519ae7a7ec54db796b46cb1764a91f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:54Z,use_quota=True,user_id='1d277ac33ba241b089e3f5fdca1e77f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d48b1242-4161-42bf-b67b-d324fbbfcdb5),volume_type_id=d48b1242-4161-42bf-b67b-d324fbbfcdb5)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Creating volume d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:27:54 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:27:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:27:54 devstack sudo[82792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 1073741824 Apr 02 10:27:54 devstack sudo[82792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:27:55 devstack sudo[82792]: pam_unix(sudo:session): session closed for user root Apr 02 10:27:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 1073741824" returned: 0 in 0.784s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:27:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:27:55 devstack sudo[83115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:27:55 devstack sudo[83115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:27:56 devstack sudo[83115]: pam_unix(sudo:session): session closed for user root Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 0.817s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ca5229-acad-44fd-aaec-04f0d89df43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d067eb41-1ce9-47a4-8443-4e217a8e8478', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662e9758-41d9-420c-9988-7c831f2b1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:56 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Volume volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 (d067eb41-1ce9-47a4-8443-4e217a8e8478): created successfully Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662e9758-41d9-420c-9988-7c831f2b1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Flow 'volume_create_manager' (b596b9d5-a0ba-4d1d-abb4-ee4f6ba2962a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:27:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e4e93f07-c150-4777-951b-c9868ce9a4dc tempest-GroupsV314Test-2115699270 None] Created volume successfully. Apr 02 10:27:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:27:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:27:58 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Cloning volume d067eb41-1ce9-47a4-8443-4e217a8e8478 to volume ccc306c6-46d7-4882-aa72-9fbfe444cbf7 Apr 02 10:27:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Creating offline snapshot 6cdcac1f-a05c-4116-b671-0344148d4753 of volume d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:27:58 devstack cinder-volume[82391]: INFO oslo.privsep.daemon [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpig5por5d/privsep.sock'] Apr 02 10:27:58 devstack sudo[83157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpig5por5d/privsep.sock Apr 02 10:27:58 devstack sudo[83157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:27:58 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:27:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Flow 'volume_create_manager' (4d6e5cc4-2cf3-4448-900b-f072cc23cc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:27:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733cd174-6bd7-4830-98ef-9eda2d408dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733cd174-6bd7-4830-98ef-9eda2d408dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-391906098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6043a199-c444-4ef6-baa6-fa1dc3de21c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255497e71c94ffaa3723141e029e3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:59Z,use_quota=True,user_id='ac0bf80d747944b59ee3e7df3dca1b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66279844-a1f2-4a35-ba5a-f279f3e639fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66279844-a1f2-4a35-ba5a-f279f3e639fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fb6e3f-3699-4437-a8f7-746c1b968194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6fb6e3f-3699-4437-a8f7-746c1b968194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6043a199-c444-4ef6-baa6-fa1dc3de21c1', 'volume_name': 'volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be42fc2d-62db-4fa1-bd43-679354a0681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be42fc2d-62db-4fa1-bd43-679354a0681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108ab0f-0c7a-428a-8091-3badebfe0aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:27:59 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Volume 6043a199-c444-4ef6-baa6-fa1dc3de21c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1', 'volume_size': 1} Apr 02 10:27:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:00 devstack sudo[83157]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:00 devstack cinder-volume[82391]: INFO oslo.privsep.daemon [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Spawned new privsep daemon via rootwrap Apr 02 10:28:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Accepted privsep connection to /tmp/tmpig5por5d/privsep.sock {{(pid=82391) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 02 10:28:00 devstack cinder-volume[82391]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 02 10:28:00 devstack cinder-volume[82391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 02 10:28:00 devstack cinder-volume[82391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 02 10:28:00 devstack cinder-volume[82391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83188 Apr 02 10:28:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbc5615-e165-44a1-86c3-342e65a00181]: (2,) {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b4dc7-ca43-44c5-a5fe-fa3ef7bb3513]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:00 devstack sudo[83190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:28:00 devstack sudo[83190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:02 devstack sudo[83190]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 1.478s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:02 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 1G Apr 02 10:28:02 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:03 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 1G" returned: 0 in 1.056s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:03 devstack sudo[83200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 Apr 02 10:28:03 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:03 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753" returned: 0 in 0.650s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:03 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:28:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:03 devstack sudo[83205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 Apr 02 10:28:03 devstack sudo[83205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:04 devstack sudo[83205]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753" returned: 0 in 0.733s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:04 devstack sudo[83208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info Apr 02 10:28:04 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:05 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info" returned: 0 in 1.169s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:05 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:28:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:05 devstack sudo[83215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info Apr 02 10:28:05 devstack sudo[83215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:06 devstack sudo[83215]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.info" returned: 0 in 0.616s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Acquiring lock "cinder-quobyte-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] snapshot: 6cdcac1f-a05c-4116-b671-0344148d4753, volume: ccc306c6-46d7-4882-aa72-9fbfe444cbf7, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ea83f-9d6c-4071-b21e-ac1f8d0eb8d2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:06 devstack sudo[83221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 Apr 02 10:28:06 devstack sudo[83221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:08 devstack sudo[83221]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753" returned: 0 in 1.432s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d067eb41-1ce9-47a4-8443-4e217a8e8478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:28:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:28:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:28:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a90bd9e-afe8-48ce-98dd-aa86835436e7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:08 devstack sudo[83226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:28:08 devstack sudo[83226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:09 devstack sudo[83226]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 1.810s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:09 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:28:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:10 devstack sudo[83232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 Apr 02 10:28:10 devstack sudo[83232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:14 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:28:14 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Flow 'volume_create_manager' (6833bd42-d0ba-47f6-af5a-c6e976e65c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b87177-5b1f-4dcc-83d8-ebefd829c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b87177-5b1f-4dcc-83d8-ebefd829c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:28:14Z,deleted=False,deleted_at=None,display_description='',display_name='69b81007-a942-4948-8bf4-c642a482ab33-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568b9488-47e3-4764-948d-8f9f2ac311bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151202acfc74d3a954df13d696be231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:15Z,use_quota=True,user_id='0f5db6dcc9a74df1b3b8e0f099cdc8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0079d3df-5fe4-4a83-ae50-7340f945cb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0079d3df-5fe4-4a83-ae50-7340f945cb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab16f984-5885-4e58-883e-73cc0deb0007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab16f984-5885-4e58-883e-73cc0deb0007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568b9488-47e3-4764-948d-8f9f2ac311bc', 'volume_name': 'volume-568b9488-47e3-4764-948d-8f9f2ac311bc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a565a68b-c4b2-43ba-859f-d51019b7a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a565a68b-c4b2-43ba-859f-d51019b7a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ff9447-74de-491e-94bf-4589a34cfe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:15 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Volume 568b9488-47e3-4764-948d-8f9f2ac311bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568b9488-47e3-4764-948d-8f9f2ac311bc', 'volume_size': 1} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:15 devstack sudo[83232]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" returned: 0 in 5.406s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d2b9e-e1d7-4f79-bc6a-34d89fa3c584]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:15 devstack sudo[83299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:28:15 devstack sudo[83299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:17 devstack sudo[83299]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 1.631s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:28:17 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Converted 1024.00 MB image at 189.38 MB/s Apr 02 10:28:17 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:17 devstack sudo[83304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 Apr 02 10:28:17 devstack sudo[83304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:17 devstack sudo[83304]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" returned: 0 in 0.645s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" released by "_copy_volume_from_snapshot" :: held 11.156s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Acquiring lock "cinder-quobyte-6cdcac1f-a05c-4116-b671-0344148d4753" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-6cdcac1f-a05c-4116-b671-0344148d4753" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Deleting offline snapshot 6cdcac1f-a05c-4116-b671-0344148d4753 of volume d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] snapshot_file for this snap is: volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af639572-bf80-4b76-a470-b342fa36292f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:18 devstack sudo[83314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 Apr 02 10:28:18 devstack sudo[83314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:19 devstack sudo[83314]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753" returned: 0 in 1.234s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d067eb41-1ce9-47a4-8443-4e217a8e8478(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:28:19 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b4f4d3-0e27-46fb-97c5-5ba07d7b1068]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:19 devstack sudo[83326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:28:19 devstack sudo[83326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:19 devstack sudo[83326]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 0.704s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:19 devstack sudo[83334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 Apr 02 10:28:19 devstack sudo[83334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:20 devstack sudo[83334]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753" returned: 0 in 0.707s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:20 devstack sudo[83343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753 Apr 02 10:28:20 devstack sudo[83343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:21 devstack sudo[83343]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478.6cdcac1f-a05c-4116-b671-0344148d4753" returned: 0 in 0.663s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-6cdcac1f-a05c-4116-b671-0344148d4753" released by "_delete_snapshot" :: held 3.479s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.128s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.217s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-391906098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6043a199-c444-4ef6-baa6-fa1dc3de21c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255497e71c94ffaa3723141e029e3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:59Z,use_quota=True,user_id='ac0bf80d747944b59ee3e7df3dca1b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Creating volume 6043a199-c444-4ef6-baa6-fa1dc3de21c1 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:28:21 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:21 devstack sudo[83348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 1073741824 Apr 02 10:28:21 devstack sudo[83348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b947e2cb-865e-4457-8bd6-a44d8f60feea tempest-GroupsV314Test-2115699270 None] Create group from source-group-8992985d-cf93-433b-94c8-41a43b9a8c59 completed successfully. Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Acquiring lock "cinder-quobyte-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:28:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" acquired by "delete_volume" :: waited 0.031s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:28:22 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3dbbe6-650a-46ca-a717-be525c913656]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:22 devstack sudo[83348]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 1073741824" returned: 0 in 0.831s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:22 devstack sudo[83353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 Apr 02 10:28:22 devstack sudo[83353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:22 devstack sudo[83355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 Apr 02 10:28:22 devstack sudo[83355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:22 devstack sudo[83353]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" returned: 0 in 0.777s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:22 devstack sudo[83361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7 Apr 02 10:28:22 devstack sudo[83361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:23 devstack sudo[83355]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1" returned: 0 in 1.152s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.070s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:28:14Z,deleted=False,deleted_at=None,display_description='',display_name='69b81007-a942-4948-8bf4-c642a482ab33-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568b9488-47e3-4764-948d-8f9f2ac311bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151202acfc74d3a954df13d696be231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:15Z,use_quota=True,user_id='0f5db6dcc9a74df1b3b8e0f099cdc8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Creating volume 568b9488-47e3-4764-948d-8f9f2ac311bc {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:28:23 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:23 devstack sudo[83365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc 1073741824 Apr 02 10:28:23 devstack sudo[83365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e108ab0f-0c7a-428a-8091-3badebfe0aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584693e0-e498-4729-92d4-935e2e091191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:23 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Volume volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 (6043a199-c444-4ef6-baa6-fa1dc3de21c1): created successfully Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584693e0-e498-4729-92d4-935e2e091191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Flow 'volume_create_manager' (4d6e5cc4-2cf3-4448-900b-f072cc23cc28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:28:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-cc50bf49-ef3d-44be-ab98-a83ca707eba2 tempest-VolumesAdminNegativeTest-996776607 None] Created volume successfully. Apr 02 10:28:23 devstack sudo[83361]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" returned: 0 in 0.920s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-ccc306c6-46d7-4882-aa72-9fbfe444cbf7" released by "delete_volume" :: held 1.801s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Created reservations ['73a28428-3ac4-47ec-9c80-f74a2fcf03fa'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:28:24 devstack cinder-volume[82391]: WARNING cinder.quota [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-680190977 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-680190977, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:28:24 devstack cinder-volume[82391]: WARNING cinder.quota [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-680190977 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-680190977, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Created reservations ['e974e6b2-be81-4b7e-bfa2-550b07f965ae', '439db3de-e166-4018-9677-e17711d55e46', 'f9198ec8-c0c5-400f-873d-c1e3d24c5437', 'ca7781af-ab0a-4dec-aaf2-b108016fc00a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:24 devstack sudo[83371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:28:24 devstack sudo[83371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:25 devstack sudo[83365]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc 1073741824" returned: 0 in 1.820s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:25 devstack sudo[83374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc Apr 02 10:28:25 devstack sudo[83374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Acquiring lock "cinder-6043a199-c444-4ef6-baa6-fa1dc3de21c1-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Lock "cinder-6043a199-c444-4ef6-baa6-fa1dc3de21c1-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Acquiring lock "cinder-quobyte-6043a199-c444-4ef6-baa6-fa1dc3de21c1" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Lock "cinder-quobyte-6043a199-c444-4ef6-baa6-fa1dc3de21c1" acquired by "delete_volume" :: waited 0.044s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3df9067-5fe7-4d34-93d1-b94e82a5efbd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:26 devstack sudo[83382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 Apr 02 10:28:26 devstack sudo[83382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:26 devstack sudo[83371]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.722s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:28:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-013d180f-aa64-4b9e-b44c-68497d3ed8e7 tempest-GroupsV314Test-2115699270 None] Delete group completed successfully. Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Acquiring lock "cinder-quobyte-d067eb41-1ce9-47a4-8443-4e217a8e8478" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-d067eb41-1ce9-47a4-8443-4e217a8e8478" acquired by "delete_volume" :: waited 0.026s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2157ba59-7fa9-42c1-8602-585f8b8c1e06]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:26 devstack sudo[83391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:28:26 devstack sudo[83391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:26 devstack sudo[83374]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc" returned: 0 in 1.474s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] <== create_volume: return (3402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.411s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ff9447-74de-491e-94bf-4589a34cfe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568b9488-47e3-4764-948d-8f9f2ac311bc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0524f9cb-d324-41be-a001-da731c8eab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:26 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Volume volume-568b9488-47e3-4764-948d-8f9f2ac311bc (568b9488-47e3-4764-948d-8f9f2ac311bc): created successfully Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0524f9cb-d324-41be-a001-da731c8eab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Flow 'volume_create_manager' (6833bd42-d0ba-47f6-af5a-c6e976e65c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:28:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-12a9ce06-2766-4b90-9e6b-2014640509e4 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Created volume successfully. Apr 02 10:28:27 devstack sudo[83391]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 1.536s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:28 devstack sudo[83427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478 Apr 02 10:28:28 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:28 devstack sudo[83382]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1" returned: 0 in 2.403s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:28 devstack sudo[83432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1 Apr 02 10:28:28 devstack sudo[83432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:29 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d067eb41-1ce9-47a4-8443-4e217a8e8478" returned: 0 in 1.168s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Lock "cinder-quobyte-d067eb41-1ce9-47a4-8443-4e217a8e8478" released by "delete_volume" :: held 2.939s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:28:29 devstack sudo[83432]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Created reservations ['c611c7fd-7b8a-484b-be8d-a2d4fa321cac'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6043a199-c444-4ef6-baa6-fa1dc3de21c1" returned: 0 in 1.142s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Lock "cinder-quobyte-6043a199-c444-4ef6-baa6-fa1dc3de21c1" released by "delete_volume" :: held 3.707s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:28:29 devstack cinder-volume[82391]: WARNING cinder.quota [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:28:29 devstack cinder-volume[82391]: WARNING cinder.quota [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Created reservations ['a33433f5-a9be-435b-8878-1d1390488473', '4dacd105-b1f8-4739-ace1-2cd673ba82b8', 'c3ccf512-d59e-4cf2-a03c-9a63496a56df', '14e3d177-f563-404d-a7ce-3405db20bace'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Created reservations ['28ae264b-a033-4fbe-b2cc-ad1728a07e6a', '025de36d-49b6-4332-8356-2553ec6c0cac', '97a7b040-d1d7-46b6-907f-238de36bd102', 'a8d10b97-6e88-4a4f-bfba-4a3fa18d12d5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:29 devstack sudo[83452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:28:29 devstack sudo[83452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:29 devstack sudo[83454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:28:29 devstack sudo[83454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:31 devstack sudo[83452]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.651s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:31 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:28:31 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Deleted volume successfully. Apr 02 10:28:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e2ef60e-7217-46f0-abed-6d529cb8f113 tempest-VolumesAdminNegativeTest-996776607 None] Lock "cinder-6043a199-c444-4ef6-baa6-fa1dc3de21c1-delete_volume" released by "delete_volume" :: held 5.844s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:28:31 devstack sudo[83454]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 2.065s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:31 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:28:31 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7735f813-80e4-4ee4-a652-46348d16d31a tempest-GroupsV314Test-2115699270 None] Delete group completed successfully. Apr 02 10:28:32 devstack cinder-volume[82391]: WARNING py.warnings [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 02 10:28:32 devstack cinder-volume[82391]: .first() Apr 02 10:28:32 devstack cinder-volume[82391]: Apr 02 10:28:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:32 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0201390-786d-4d47-910b-a18d6aabdf53]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:28:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:32 devstack sudo[83512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc Apr 02 10:28:32 devstack sudo[83512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:33 devstack sudo[83512]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc" returned: 0 in 1.009s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.045s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372', 'name': 'volume-568b9488-47e3-4764-948d-8f9f2ac311bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ef04094-e297-4ab3-bd8b-5cde66c6f453', 'enforce_multipath': True} {{(pid=82391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 10:28:33 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-286e930e-281c-430b-ace5-66ee81d83fa2 req-1ce8c790-73cd-43ad-8338-a99dc80d6445 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] attachment_update completed successfully. Apr 02 10:28:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a37f086f-2b01-4beb-88a5-2fb82d9e8823 tempest-GroupsV320Test-1697817557 None] Group tempest-GroupsV320Test-Group-1341416728: creating Apr 02 10:28:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a37f086f-2b01-4beb-88a5-2fb82d9e8823 tempest-GroupsV320Test-1697817557 None] Group tempest-GroupsV320Test-Group-1341416728: created successfully Apr 02 10:28:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a37f086f-2b01-4beb-88a5-2fb82d9e8823 tempest-GroupsV320Test-1697817557 None] Create group completed successfully. Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Created reservations ['67ab481f-e676-44af-9f59-bc4cca62d4a0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:39 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:28:39 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:41 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:41 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:28:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-fef680b0-f6ec-4a38-98fb-15d1291416ef tempest-GroupsV320Test-1697817557 None] Delete group completed successfully. Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:46 devstack sudo[84009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:28:46 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:47 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:47 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:28:49 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=39,cinder:UPDATE=35,cinder:INSERT=4 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:28:49 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=51,cinder:SELECT=41,cinder:INSERT=13,cinder:DELETE=3 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Flow 'volume_create_manager' (344c0648-e15d-45ff-b6b0-4c659e7fb527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1e8c62-af13-411d-9af3-e265f41e5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1e8c62-af13-411d-9af3-e265f41e5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1326366270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f0dc38-297c-40da-a35e-38862409e4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264411eed4f943fbaf554e8d7d8176eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:58Z,use_quota=True,user_id='34f98e8d7eb840f39f25981bc4a96196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97043f4a-bc2b-479e-9d7c-bf632a80546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97043f4a-bc2b-479e-9d7c-bf632a80546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546e017e-0d49-4bab-b5ec-8edc653d78e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546e017e-0d49-4bab-b5ec-8edc653d78e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f0dc38-297c-40da-a35e-38862409e4f2', 'volume_name': 'volume-59f0dc38-297c-40da-a35e-38862409e4f2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb4edb4-a41d-48a9-b470-38952dfdcafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb4edb4-a41d-48a9-b470-38952dfdcafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1561a3ca-d7d8-45a6-a4d3-04d0d608ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:28:57 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Volume 59f0dc38-297c-40da-a35e-38862409e4f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f0dc38-297c-40da-a35e-38862409e4f2', 'volume_size': 1} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1326366270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f0dc38-297c-40da-a35e-38862409e4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264411eed4f943fbaf554e8d7d8176eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:58Z,use_quota=True,user_id='34f98e8d7eb840f39f25981bc4a96196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Creating volume 59f0dc38-297c-40da-a35e-38862409e4f2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:28:57 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:28:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:58 devstack sudo[84197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 1073741824 Apr 02 10:28:58 devstack sudo[84197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:28:59 devstack sudo[84197]: pam_unix(sudo:session): session closed for user root Apr 02 10:28:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 1073741824" returned: 0 in 1.643s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:28:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:28:59 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 Apr 02 10:28:59 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:00 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2" returned: 0 in 1.343s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] <== create_volume: return (3096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:29:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.115s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1561a3ca-d7d8-45a6-a4d3-04d0d608ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f0dc38-297c-40da-a35e-38862409e4f2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95f31f4-ba00-428e-a169-ea7dd12d1f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Volume volume-59f0dc38-297c-40da-a35e-38862409e4f2 (59f0dc38-297c-40da-a35e-38862409e4f2): created successfully Apr 02 10:29:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95f31f4-ba00-428e-a169-ea7dd12d1f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Flow 'volume_create_manager' (344c0648-e15d-45ff-b6b0-4c659e7fb527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:01 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7a641e87-d90c-4098-87bc-f574dab44de0 tempest-ServerRescueNegativeTestJSON-1717073220 None] Created volume successfully. Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Flow 'volume_create_manager' (a0c43509-a5f7-49b2-8a0b-cf0afe977e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1186f803-12ae-4b0d-82c4-45cb6bb11889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1186f803-12ae-4b0d-82c4-45cb6bb11889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1811280085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a59e69-f8f9-4383-8aac-42e35e3f9f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34f14d13e6a4811ad4681823eda092d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:11Z,use_quota=True,user_id='2fe1d6a9661b458391e7d7b1abafaa8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83562150-fc27-47c7-8b4b-10bb7c8070db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83562150-fc27-47c7-8b4b-10bb7c8070db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0b4393-7007-4a22-bdff-3468d32242c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0b4393-7007-4a22-bdff-3468d32242c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a59e69-f8f9-4383-8aac-42e35e3f9f28', 'volume_name': 'volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc479e-d0b5-450b-93aa-2b581e17be94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc479e-d0b5-450b-93aa-2b581e17be94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbf808f-1e25-40a9-9cff-f61ed837675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:11 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Volume c9a59e69-f8f9-4383-8aac-42e35e3f9f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28', 'volume_size': 1} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1811280085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a59e69-f8f9-4383-8aac-42e35e3f9f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34f14d13e6a4811ad4681823eda092d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:11Z,use_quota=True,user_id='2fe1d6a9661b458391e7d7b1abafaa8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Creating volume c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:29:11 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:29:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:11 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 1073741824 Apr 02 10:29:11 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:12 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 1073741824" returned: 0 in 0.864s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:12 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 Apr 02 10:29:12 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:12 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" returned: 0 in 0.639s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbf808f-1e25-40a9-9cff-f61ed837675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fa5db6-6243-4f64-91e1-b70bd4f311a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:12 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Volume volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 (c9a59e69-f8f9-4383-8aac-42e35e3f9f28): created successfully Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fa5db6-6243-4f64-91e1-b70bd4f311a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Flow 'volume_create_manager' (a0c43509-a5f7-49b2-8a0b-cf0afe977e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:12 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0e9f5488-a9d6-4302-8d9d-739e7a66f72a tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Created volume successfully. Apr 02 10:29:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Creating offline snapshot a9b51523-c37e-4a7f-b7d6-7a253cf8b61c of volume c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:29:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1389dd1-0d10-4d74-a925-aaf14e12d72d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:13 devstack sudo[84390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 Apr 02 10:29:13 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:14 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" returned: 0 in 0.891s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:14 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c 1G Apr 02 10:29:14 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:15 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c 1G" returned: 0 in 1.283s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:16 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c Apr 02 10:29:16 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:16 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" returned: 0 in 0.764s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:16 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c is being set with open permissions: ugo+rw Apr 02 10:29:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:16 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c Apr 02 10:29:16 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:18 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" returned: 0 in 1.314s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:18 devstack sudo[84447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info Apr 02 10:29:18 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:19 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info" returned: 0 in 1.387s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:19 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info is being set with open permissions: ugo+rw Apr 02 10:29:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:19 devstack sudo[84467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info Apr 02 10:29:19 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:20 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.info" returned: 0 in 1.366s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.273s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3a6b73ae-e653-4d4c-b798-923173856865 tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Create snapshot completed successfully Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "cinder-a9b51523-c37e-4a7f-b7d6-7a253cf8b61c-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-a9b51523-c37e-4a7f-b7d6-7a253cf8b61c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "cinder-quobyte-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-quobyte-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "cinder-quobyte-a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-quobyte-a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Deleting offline snapshot a9b51523-c37e-4a7f-b7d6-7a253cf8b61c of volume c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] snapshot_file for this snap is: volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d64f4-7954-433f-a116-32139aaf5490]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:22 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c Apr 02 10:29:22 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:23 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" returned: 0 in 1.086s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:29:23 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[339b0473-8e94-477f-9ccb-0dfa4356fad4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:23 devstack sudo[84543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 Apr 02 10:29:23 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:24 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" returned: 0 in 1.337s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:24 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c Apr 02 10:29:24 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Acquiring lock "cinder-59f0dc38-297c-40da-a35e-38862409e4f2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "cinder-59f0dc38-297c-40da-a35e-38862409e4f2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Acquiring lock "cinder-quobyte-59f0dc38-297c-40da-a35e-38862409e4f2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "cinder-quobyte-59f0dc38-297c-40da-a35e-38862409e4f2" acquired by "delete_volume" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e59ab0-386d-44c2-a0a9-b34be6070c04]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:25 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" returned: 0 in 1.239s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:26 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c Apr 02 10:29:26 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:26 devstack sudo[84586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 Apr 02 10:29:26 devstack sudo[84586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:26 devstack sudo[84586]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2" returned: 0 in 0.856s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:26 devstack sudo[84616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2 Apr 02 10:29:26 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:26 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28.a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" returned: 0 in 1.022s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-quobyte-a9b51523-c37e-4a7f-b7d6-7a253cf8b61c" released by "_delete_snapshot" :: held 4.852s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-quobyte-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" released by "delete_snapshot" :: held 4.960s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:27 devstack cinder-volume[82391]: WARNING cinder.quota [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Created reservations ['86ca4784-d6c9-40ee-a7cb-9fdf6de04e8c', '413e23e9-63ab-43b1-9bd0-b433a7e6b7dd', '2b17f9f3-64fa-4e52-85ee-e6c619551259', '1d9bccaa-5508-49a4-ae78-c0e5c76eef7a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:29:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Delete snapshot completed successfully. Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-58eaaaf8-8ecc-4366-ae3c-38838ae5d6cb tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-a9b51523-c37e-4a7f-b7d6-7a253cf8b61c-delete_snapshot" released by "delete_snapshot" :: held 5.230s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "cinder-c9a59e69-f8f9-4383-8aac-42e35e3f9f28-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-c9a59e69-f8f9-4383-8aac-42e35e3f9f28-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "cinder-quobyte-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-quobyte-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dbf7e6-0dbd-4a9b-a9aa-dd40a5c7b215]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:27 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 Apr 02 10:29:27 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:28 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-59f0dc38-297c-40da-a35e-38862409e4f2" returned: 0 in 1.782s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "cinder-quobyte-59f0dc38-297c-40da-a35e-38862409e4f2" released by "delete_volume" :: held 2.690s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Created reservations ['f3dd8dbc-47b2-4055-b3e0-e95285f3cbc7', '68326072-ec45-4125-8470-ade9f9021d04', '7113c530-1dd1-4176-9c5a-fd31315824cd', '2dcce709-2a62-4728-a3fd-940ff9768d9e'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:29:28 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" returned: 0 in 0.933s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:28 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28 Apr 02 10:29:28 devstack sudo[84632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:29:28 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:28 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:29 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" returned: 0 in 1.171s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-quobyte-c9a59e69-f8f9-4383-8aac-42e35e3f9f28" released by "delete_volume" :: held 2.307s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:30 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.258s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:29:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Deleted volume successfully. Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a112d70-6aaf-4fe0-b15c-439bf0d951fd tempest-ServerRescueNegativeTestJSON-1717073220 None] Lock "cinder-59f0dc38-297c-40da-a35e-38862409e4f2-delete_volume" released by "delete_volume" :: held 4.308s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Created reservations ['c30a64f2-ac3b-4dd2-a7bd-c18e3430546a', '07c592a7-c19e-4256-bc1d-008ef84f412a', '62612636-d683-455a-a601-d330b572b037', '519647fb-665a-49c6-b20a-eeb97271a57a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:30 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:29:30 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:31 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.455s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:31 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:29:31 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Deleted volume successfully. Apr 02 10:29:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f8b31f21-8b1c-4121-8039-95291d3a582b tempest-VolumeSnapshotQuotasNegativeTestJSON-762765625 None] Lock "cinder-c9a59e69-f8f9-4383-8aac-42e35e3f9f28-delete_volume" released by "delete_volume" :: held 4.103s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Flow 'volume_create_manager' (e4f50f73-a0c1-4dbf-8749-4f01fe541824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b51755-5e59-460e-b054-e3ff633dd8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b51755-5e59-460e-b054-e3ff633dd8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-965886572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b49292-16e3-4c4a-abc9-f447cfb2e2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830d1032d6b449b8afc26420e90a6fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:39Z,use_quota=True,user_id='5dad6bd97c93453982c81239386fe0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a78aae-9864-4584-a085-85dab205c0b3),volume_type_id=e9a78aae-9864-4584-a085-85dab205c0b3)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e5c6af-bc2a-4f4c-a84a-ddbabbb079a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e5c6af-bc2a-4f4c-a84a-ddbabbb079a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e7374e-4320-429c-af90-aed2bd8d6dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e7374e-4320-429c-af90-aed2bd8d6dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b49292-16e3-4c4a-abc9-f447cfb2e2df', 'volume_name': 'volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63b6e8c-438f-4cda-83e9-9732ee45ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63b6e8c-438f-4cda-83e9-9732ee45ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c47c62c-b56e-434c-b50c-c22f6dcbaff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:39 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Volume 53b49292-16e3-4c4a-abc9-f447cfb2e2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df', 'volume_size': 1} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-965886572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b49292-16e3-4c4a-abc9-f447cfb2e2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830d1032d6b449b8afc26420e90a6fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:39Z,use_quota=True,user_id='5dad6bd97c93453982c81239386fe0dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9a78aae-9864-4584-a085-85dab205c0b3),volume_type_id=e9a78aae-9864-4584-a085-85dab205c0b3)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Creating volume 53b49292-16e3-4c4a-abc9-f447cfb2e2df {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:29:39 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:29:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:39 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df 1073741824 Apr 02 10:29:39 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:40 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df 1073741824" returned: 0 in 0.759s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:40 devstack sudo[84758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df Apr 02 10:29:40 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:41 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df" returned: 0 in 0.572s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c47c62c-b56e-434c-b50c-c22f6dcbaff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb7e2f2-ec64-4da0-928e-786f45e5b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:41 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Volume volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df (53b49292-16e3-4c4a-abc9-f447cfb2e2df): created successfully Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb7e2f2-ec64-4da0-928e-786f45e5b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Flow 'volume_create_manager' (e4f50f73-a0c1-4dbf-8749-4f01fe541824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-10a8b576-a950-44fa-987a-130f89ff529c tempest-VolumeTypesAccessTest-1539960216 None] Created volume successfully. Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Acquiring lock "cinder-53b49292-16e3-4c4a-abc9-f447cfb2e2df-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Lock "cinder-53b49292-16e3-4c4a-abc9-f447cfb2e2df-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Acquiring lock "cinder-quobyte-53b49292-16e3-4c4a-abc9-f447cfb2e2df" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Lock "cinder-quobyte-53b49292-16e3-4c4a-abc9-f447cfb2e2df" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9325c75a-f4fa-41e3-bc3a-310875dd6d58]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:41 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df Apr 02 10:29:41 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:42 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df" returned: 0 in 0.623s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:42 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df Apr 02 10:29:42 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:43 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-53b49292-16e3-4c4a-abc9-f447cfb2e2df" returned: 0 in 0.654s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Lock "cinder-quobyte-53b49292-16e3-4c4a-abc9-f447cfb2e2df" released by "delete_volume" :: held 1.395s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:43 devstack cinder-volume[82391]: WARNING cinder.quota [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1491056254 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1491056254, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:29:43 devstack cinder-volume[82391]: WARNING cinder.quota [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1491056254 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1491056254, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Created reservations ['8f11f719-d27c-457c-aea5-8e72547f66e1', '0b9ae48a-2388-49c7-9f33-643251709965', '1b728f17-4893-4cb7-9c95-cb8d81b3846f', 'f626b158-7bf5-42e1-ade2-2866d078990c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:43 devstack sudo[84803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:29:43 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:44 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.721s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:44 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:29:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Deleted volume successfully. Apr 02 10:29:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e28043b4-45f6-45a5-ac4a-dd6caf6fdf67 tempest-VolumeTypesAccessTest-1539960216 None] Lock "cinder-53b49292-16e3-4c4a-abc9-f447cfb2e2df-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:46 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:29:46 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:47 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.229s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:47 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Flow 'volume_create_manager' (afa42412-42d1-4a9a-809b-a24fac6a9a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2b88c5-ccd3-48d4-a6fe-cb751f995ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2b88c5-ccd3-48d4-a6fe-cb751f995ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2016156960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3facbf1-8f49-440e-b2e5-8f4af2635ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf9271199d14118845d44fe03bf87b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:49Z,use_quota=True,user_id='e7d714967e994107adf5ee2d8d45b59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b95c544-f80e-40e6-9a69-fc539e302aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b95c544-f80e-40e6-9a69-fc539e302aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106bb503-b8ca-4379-a3ff-eda68460c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106bb503-b8ca-4379-a3ff-eda68460c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3facbf1-8f49-440e-b2e5-8f4af2635ffc', 'volume_name': 'volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52eaf21-3527-4d45-9804-e6c2f853db5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52eaf21-3527-4d45-9804-e6c2f853db5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb288d7-2e0c-4e44-af07-2287f5034507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:48 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Volume a3facbf1-8f49-440e-b2e5-8f4af2635ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc', 'volume_size': 1} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2016156960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3facbf1-8f49-440e-b2e5-8f4af2635ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf9271199d14118845d44fe03bf87b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:49Z,use_quota=True,user_id='e7d714967e994107adf5ee2d8d45b59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Creating volume a3facbf1-8f49-440e-b2e5-8f4af2635ffc {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:29:48 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:29:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:48 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc 1073741824 Apr 02 10:29:48 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Flow 'volume_create_manager' (4de56d06-dede-4115-842f-ed5bf9f043f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e29482f-a2de-4022-9eb0-ca5f0bcde15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e29482f-a2de-4022-9eb0-ca5f0bcde15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faac1295-c09e-4cc1-bdc0-7b1d74cdaad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151202acfc74d3a954df13d696be231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:49Z,use_quota=True,user_id='0f5db6dcc9a74df1b3b8e0f099cdc8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fc8d83-aa90-40ae-aa27-d5f29d4adb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fc8d83-aa90-40ae-aa27-d5f29d4adb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe19603-014a-4d0e-9819-a082c8730c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:49 devstack cinder-volume[82391]: DEBUG cinder.image.glance [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Creating Keystone auth plugin from conf {{(pid=82391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe19603-014a-4d0e-9819-a082c8730c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'faac1295-c09e-4cc1-bdc0-7b1d74cdaad4', 'volume_name': 'volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2f0cae-3001-4766-8cd7-a146815aa6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2f0cae-3001-4766-8cd7-a146815aa6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78633249-8c2f-418e-9bbe-66e03f841284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Volume faac1295-c09e-4cc1-bdc0-7b1d74cdaad4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Trying to clone faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d at location (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]). {{(pid=82391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 10:29:50 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc 1073741824" returned: 0 in 1.746s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=41,cinder:SELECT=36,cinder:DELETE=1,cinder:INSERT=9 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:50 devstack sudo[84850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc Apr 02 10:29:50 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 10:29:50 devstack cinder-volume[82391]: INFO cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Image download 20.69 MB at 20.69 MB/s Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6a4f1-c7da-4721-930d-b73b52ff003b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:51 devstack sudo[84853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD Apr 02 10:29:51 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:52 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" returned: 0 in 1.353s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] <== create_volume: return (3265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.272s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb288d7-2e0c-4e44-af07-2287f5034507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450ed225-d883-48e8-a04d-a8cb613cc06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:29:52 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Volume volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc (a3facbf1-8f49-440e-b2e5-8f4af2635ffc): created successfully Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450ed225-d883-48e8-a04d-a8cb613cc06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Flow 'volume_create_manager' (afa42412-42d1-4a9a-809b-a24fac6a9a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:29:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b3ac0485-7459-4c4e-ad69-4ef61c8be784 tempest-DeleteServersTestJSON-684724195 None] Created volume successfully. Apr 02 10:29:52 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD" returned: 0 in 1.385s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d is fetched for user 0f5db6dcc9a74df1b3b8e0f099cdc8b4. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb526692-0011-4aad-bd4a-d5e0f047926c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:52 devstack sudo[84861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD Apr 02 10:29:52 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:53 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD" returned: 0 in 1.466s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:29:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faac1295-c09e-4cc1-bdc0-7b1d74cdaad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151202acfc74d3a954df13d696be231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:49Z,use_quota=True,user_id='0f5db6dcc9a74df1b3b8e0f099cdc8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Creating volume faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:29:53 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:29:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:53 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 1073741824 Apr 02 10:29:53 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:55 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 1073741824" returned: 0 in 1.592s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:55 devstack sudo[84878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:29:55 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:56 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 0 in 1.100s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] <== create_volume: return (2754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:29:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.758s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:56 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Attempting download of 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume faac1295-c09e-4cc1-bdc0-7b1d74cdaad4. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 10:29:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89257b8-93ff-4df8-af22-5c30c428e19c]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:57 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k Apr 02 10:29:57 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:57 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k" returned: 0 in 1.182s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:29:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:29:58 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a98ee-c6e9-41d8-a207-23960c167367]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:58 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k Apr 02 10:29:58 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:58 devstack sudo[84904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc Apr 02 10:29:58 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:59 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k" returned: 1 in 1.179s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_9kw_ht2k' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab1f8d-e11e-4c24-9b10-dd8b387ff9c2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:29:59 devstack sudo[84918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD Apr 02 10:29:59 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:29:59 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" returned: 0 in 1.159s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.185s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:29:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372', 'name': 'volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6c43a7f-a51f-4dea-a623-153a6bf057f0', 'enforce_multipath': True} {{(pid=82391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 10:29:59 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-73bb2acb-a7cc-4466-92f3-aa8f65614f6c req-db739590-ea3a-4ee1-8188-040375d7cec5 tempest-DeleteServersTestJSON-684724195 None] attachment_update completed successfully. Apr 02 10:30:00 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD" returned: 0 in 1.303s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:00 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] 25308ee5-ba0c-42b9-8fcd-f0100169d78d was qcow2, converting to raw {{(pid=82391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 10:30:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:00 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:00 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:03 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 0 in 2.740s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:03 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_4pmk4vwrdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:30:03 devstack cinder-volume[82391]: INFO cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Converted 112.00 MB image at 40.83 MB/s Apr 02 10:30:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:03 devstack sudo[84961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 1G Apr 02 10:30:03 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:04 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 1G" returned: 0 in 1.098s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29390990-24d7-4cbe-9913-20562f2ef5cf]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:04 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:04 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:05 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 0 in 1.234s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:05 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:05 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:06 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 1 in 0.896s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Downloaded image 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 successfully. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d for user 0f5db6dcc9a74df1b3b8e0f099cdc8b4 is deleted. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Marking volume faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 as bootable. {{(pid=82391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Copying metadata from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d to faac1295-c09e-4cc1-bdc0-7b1d74cdaad4. {{(pid=82391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Creating volume glance metadata for volume faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 backed by image 25308ee5-ba0c-42b9-8fcd-f0100169d78d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78633249-8c2f-418e-9bbe-66e03f841284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233a7eb9-fc45-4741-a6e7-19008b86e2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:06 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Volume volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 (faac1295-c09e-4cc1-bdc0-7b1d74cdaad4): created successfully Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233a7eb9-fc45-4741-a6e7-19008b86e2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Flow 'volume_create_manager' (4de56d06-dede-4115-842f-ed5bf9f043f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-13cdda5a-c5c0-41ce-b03e-76d701885996 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Created volume successfully. Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[118719ff-918d-4a4f-8d71-0dffcfaee644]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:08 devstack sudo[85013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:08 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:08 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-295aad38-5e7c-47c3-898e-b8d4aa9e599a req-fe730cb3-723e-495a-8dba-94898a5c0b99 tempest-DeleteServersTestJSON-684724195 None] Terminate volume connection completed successfully. Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-295aad38-5e7c-47c3-898e-b8d4aa9e599a req-fe730cb3-723e-495a-8dba-94898a5c0b99 tempest-DeleteServersTestJSON-684724195 None] Deleting attachment b6c43a7f-a51f-4dea-a623-153a6bf057f0. {{(pid=82391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Flow 'volume_create_manager' (d061d6c2-65be-49ca-8878-55ec4885740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abea740-f430-4fb6-99c7-68bf18c91421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abea740-f430-4fb6-99c7-68bf18c91421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2065407976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0e34cb-79f3-458b-9fbe-4d259e827540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea5b87285f9469791a9f9e1190e3854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:09Z,use_quota=True,user_id='809db4a504c94252b0c183dabf3aa8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b58cf8-2e6d-4c24-9013-74cbd926b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b58cf8-2e6d-4c24-9013-74cbd926b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e626641f-40ef-47d4-84fb-7e88341cd7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e626641f-40ef-47d4-84fb-7e88341cd7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0e34cb-79f3-458b-9fbe-4d259e827540', 'volume_name': 'volume-8d0e34cb-79f3-458b-9fbe-4d259e827540', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be87ad43-97aa-4271-8c62-90c10a6d7dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be87ad43-97aa-4271-8c62-90c10a6d7dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb07d94-bcaa-476e-bcea-7867eabf1379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:08 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Volume 8d0e34cb-79f3-458b-9fbe-4d259e827540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0e34cb-79f3-458b-9fbe-4d259e827540', 'volume_size': 1} Apr 02 10:30:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:09 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 0 in 1.016s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:09 devstack sudo[85019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:09 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:10 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 1 in 0.691s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.746s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2065407976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0e34cb-79f3-458b-9fbe-4d259e827540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea5b87285f9469791a9f9e1190e3854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:09Z,use_quota=True,user_id='809db4a504c94252b0c183dabf3aa8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Creating volume 8d0e34cb-79f3-458b-9fbe-4d259e827540 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:10 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372', 'name': 'volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6ae8ba9-e9c9-4e6d-8e99-78a4181789d3', 'enforce_multipath': True} {{(pid=82391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 02 10:30:10 devstack sudo[85025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 1073741824 Apr 02 10:30:10 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:10 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-9f08e5e7-66bd-4e10-a049-9b6a1a245afa req-ee433702-352c-4e1b-bbab-6ca1e884fc4c tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] attachment_update completed successfully. Apr 02 10:30:11 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 1073741824" returned: 0 in 0.854s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:11 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 Apr 02 10:30:11 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:11 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540" returned: 0 in 0.586s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb07d94-bcaa-476e-bcea-7867eabf1379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0e34cb-79f3-458b-9fbe-4d259e827540', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5348573-86e4-4df9-a504-6f80cdbb1d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=51,cinder:UPDATE=53,cinder:DELETE=7,cinder:INSERT=18 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:30:11 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Volume volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 (8d0e34cb-79f3-458b-9fbe-4d259e827540): created successfully Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5348573-86e4-4df9-a504-6f80cdbb1d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Flow 'volume_create_manager' (d061d6c2-65be-49ca-8878-55ec4885740a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:11 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1ce1ccdb-e75b-4241-ab06-c8212ef72c4a tempest-VolumesTransfersV355Test-588354529 None] Created volume successfully. Apr 02 10:30:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Acquiring lock "cinder-a3facbf1-8f49-440e-b2e5-8f4af2635ffc-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Lock "cinder-a3facbf1-8f49-440e-b2e5-8f4af2635ffc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Acquiring lock "cinder-quobyte-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Lock "cinder-quobyte-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:12 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a452618-1474-44e8-8eca-912c7e88a707]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:12 devstack sudo[85034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc Apr 02 10:30:12 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:13 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" returned: 0 in 0.707s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:13 devstack sudo[85043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc Apr 02 10:30:13 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a58363b6-5959-4b16-b099-47e300aa3f1d tempest-VolumesTransfersV355Test-1735062979 None] Transfer volume completed successfully. Apr 02 10:30:13 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" returned: 0 in 0.514s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Lock "cinder-quobyte-a3facbf1-8f49-440e-b2e5-8f4af2635ffc" released by "delete_volume" :: held 1.248s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Created reservations ['0553c14f-6b6a-483b-9cc5-f64521222ca8', 'ea4645d0-6701-4cdd-8e85-92d55976d762', '7fbc5d1a-12f3-4fcc-9cf9-79a5575786f5', '36b6134c-8a69-4696-95fe-001c316f0473'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:13 devstack sudo[85052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:13 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Acquiring lock "cinder-8d0e34cb-79f3-458b-9fbe-4d259e827540-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-8d0e34cb-79f3-458b-9fbe-4d259e827540-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Acquiring lock "cinder-quobyte-8d0e34cb-79f3-458b-9fbe-4d259e827540" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-quobyte-8d0e34cb-79f3-458b-9fbe-4d259e827540" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0647a1-97e5-4906-9040-0d0afd952dd1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:14 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.580s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Deleted volume successfully. Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d100d72f-52d0-450c-bfbd-7b54379f7111 tempest-DeleteServersTestJSON-684724195 None] Lock "cinder-a3facbf1-8f49-440e-b2e5-8f4af2635ffc-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:14 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 Apr 02 10:30:14 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:14 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540" returned: 0 in 0.654s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:14 devstack sudo[85082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540 Apr 02 10:30:14 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:16 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8d0e34cb-79f3-458b-9fbe-4d259e827540" returned: 0 in 1.126s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-quobyte-8d0e34cb-79f3-458b-9fbe-4d259e827540" released by "delete_volume" :: held 1.829s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Created reservations ['15c757b4-9ec7-46dd-b087-7b4394c7ab1c', '84d6d319-3a19-49c3-9c9d-435d5d99a173', '2d2f38d3-1d34-429f-b490-bc6ea1f75382', 'a0700535-f985-4413-831b-0abf5fecdc38'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:16 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:16 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:16 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Flow 'volume_create_manager' (45deb2db-95e3-4766-9d5c-37c874e84128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a5b796-2588-4a3b-bc74-28a8f5cbbf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a5b796-2588-4a3b-bc74-28a8f5cbbf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-883965685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48048bef-96e7-400e-8e67-4ab01ed58c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea5b87285f9469791a9f9e1190e3854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:17Z,use_quota=True,user_id='809db4a504c94252b0c183dabf3aa8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e80287-71b3-4e8a-9d82-80b7e1ec0ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e80287-71b3-4e8a-9d82-80b7e1ec0ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3686ed86-36a0-4e42-a9c7-0ec4bda4cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3686ed86-36a0-4e42-a9c7-0ec4bda4cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48048bef-96e7-400e-8e67-4ab01ed58c15', 'volume_name': 'volume-48048bef-96e7-400e-8e67-4ab01ed58c15', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85fb0ff-92c5-403b-beb1-53e71f5d4bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85fb0ff-92c5-403b-beb1-53e71f5d4bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa315fe-203e-4a75-9fc0-65ab1b464e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:16 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Volume 48048bef-96e7-400e-8e67-4ab01ed58c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48048bef-96e7-400e-8e67-4ab01ed58c15', 'volume_size': 1} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-883965685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48048bef-96e7-400e-8e67-4ab01ed58c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea5b87285f9469791a9f9e1190e3854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:17Z,use_quota=True,user_id='809db4a504c94252b0c183dabf3aa8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Creating volume 48048bef-96e7-400e-8e67-4ab01ed58c15 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:16 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.786s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:16 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Deleted volume successfully. Apr 02 10:30:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ed556390-b845-488b-969c-75a91fdea551 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-8d0e34cb-79f3-458b-9fbe-4d259e827540-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:17 devstack sudo[85127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 1073741824 Apr 02 10:30:17 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:18 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 1073741824" returned: 0 in 1.267s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:18 devstack sudo[85134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 Apr 02 10:30:18 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:19 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15" returned: 0 in 1.139s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] <== create_volume: return (2502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.506s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa315fe-203e-4a75-9fc0-65ab1b464e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48048bef-96e7-400e-8e67-4ab01ed58c15', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cb4e10-f396-40fc-8a41-6b9746c07a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:19 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Volume volume-48048bef-96e7-400e-8e67-4ab01ed58c15 (48048bef-96e7-400e-8e67-4ab01ed58c15): created successfully Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92cb4e10-f396-40fc-8a41-6b9746c07a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Flow 'volume_create_manager' (45deb2db-95e3-4766-9d5c-37c874e84128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-12088ea9-31cb-4e4e-8279-1cd1e65174e0 tempest-VolumesTransfersV355Test-588354529 None] Created volume successfully. Apr 02 10:30:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Acquiring lock "cinder-48048bef-96e7-400e-8e67-4ab01ed58c15-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-48048bef-96e7-400e-8e67-4ab01ed58c15-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Acquiring lock "cinder-quobyte-48048bef-96e7-400e-8e67-4ab01ed58c15" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-quobyte-48048bef-96e7-400e-8e67-4ab01ed58c15" acquired by "delete_volume" :: waited 0.038s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[225872f1-c02f-4ec8-992a-4a4aa5d5e14b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:20 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 Apr 02 10:30:20 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:21 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15" returned: 0 in 0.853s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:21 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15 Apr 02 10:30:21 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:22 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-48048bef-96e7-400e-8e67-4ab01ed58c15" returned: 0 in 0.774s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-quobyte-48048bef-96e7-400e-8e67-4ab01ed58c15" released by "delete_volume" :: held 1.679s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Created reservations ['a73fecc8-5c12-4d4f-a0b8-a048008d0d50', '7416575b-8a3f-4cec-8b00-d36717ad9065', 'cad39e2e-2c0f-45db-963c-56a4a99f0eb5', '66851bdb-3aed-46a8-bc5e-85ab5f36d6f6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:22 devstack sudo[85165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:22 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:23 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.626s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:23 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Deleted volume successfully. Apr 02 10:30:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-112d5757-aac4-4aab-a19d-a3e3988d8509 tempest-VolumesTransfersV355Test-765884388 None] Lock "cinder-48048bef-96e7-400e-8e67-4ab01ed58c15-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:25 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-67871046-1a76-4c6d-93c6-8c8f30df9299 tempest-GroupSnapshotsTest-1729284295 None] Group tempest-GroupSnapshotsTest-Group-1269777080: creating Apr 02 10:30:25 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-67871046-1a76-4c6d-93c6-8c8f30df9299 tempest-GroupSnapshotsTest-1729284295 None] Group tempest-GroupSnapshotsTest-Group-1269777080: created successfully Apr 02 10:30:25 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-67871046-1a76-4c6d-93c6-8c8f30df9299 tempest-GroupSnapshotsTest-1729284295 None] Create group completed successfully. Apr 02 10:30:26 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (cbf32a23-1296-4392-937f-efd40199927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d42159-a6a6-4fd1-8584-f4da74937636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d42159-a6a6-4fd1-8584-f4da74937636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1258518648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7938ba14-7a3d-472a-9a0c-7d30ca4d9a48,host='devstack@QuobyteHD#QuobyteHD',id=4189a27e-9cbc-4cb1-a450-fef09af4d9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:27Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41e77ea3-7cba-4e35-9606-e9fc97aeff8d),volume_type_id=41e77ea3-7cba-4e35-9606-e9fc97aeff8d)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17ed821-2d2a-4bfe-99ca-fe34b04348ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17ed821-2d2a-4bfe-99ca-fe34b04348ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6f3314-52c6-40db-8704-dd47af65bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6f3314-52c6-40db-8704-dd47af65bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4189a27e-9cbc-4cb1-a450-fef09af4d9b3', 'volume_name': 'volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdac5dd-6466-461d-9d44-cc2a16c7220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdac5dd-6466-461d-9d44-cc2a16c7220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa21c426-eb65-49ba-9b4d-d4578c79ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:27 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Volume 4189a27e-9cbc-4cb1-a450-fef09af4d9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3', 'volume_size': 1} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7938ba14-7a3d-472a-9a0c-7d30ca4d9a48,created_at=2026-04-02T08:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1258518648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7938ba14-7a3d-472a-9a0c-7d30ca4d9a48,host='devstack@QuobyteHD#QuobyteHD',id=4189a27e-9cbc-4cb1-a450-fef09af4d9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:27Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41e77ea3-7cba-4e35-9606-e9fc97aeff8d),volume_type_id=41e77ea3-7cba-4e35-9606-e9fc97aeff8d)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Creating volume 4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:27 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:27 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 1073741824 Apr 02 10:30:27 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:28 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 1073741824" returned: 0 in 0.789s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:28 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:28 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Flow 'volume_create_manager' (4f7eda59-7568-4b43-bdbf-43ec92bcf9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6fce13-72b8-4d55-b5dc-847577a73499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6fce13-72b8-4d55-b5dc-847577a73499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-110762830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c21616a-8661-4913-bec1-166f8c55d28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192205213e24437aa738ede5cd25e02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:29Z,use_quota=True,user_id='00c61d6493544b998c02fc90d70f4e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:28 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36e86ca-8100-47f4-8e8e-794713b13efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36e86ca-8100-47f4-8e8e-794713b13efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8c7893-7d30-4813-aa0f-82a35d5561dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8c7893-7d30-4813-aa0f-82a35d5561dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c21616a-8661-4913-bec1-166f8c55d28f', 'volume_name': 'volume-2c21616a-8661-4913-bec1-166f8c55d28f', 'volume_size': 2}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6a4094-ee4a-45e4-a713-837195ce7876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6a4094-ee4a-45e4-a713-837195ce7876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53aca2a0-5ee1-4497-a780-b85cd38e2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:28 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Volume 2c21616a-8661-4913-bec1-166f8c55d28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c21616a-8661-4913-bec1-166f8c55d28f', 'volume_size': 2} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 0.679s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-110762830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c21616a-8661-4913-bec1-166f8c55d28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192205213e24437aa738ede5cd25e02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:29Z,use_quota=True,user_id='00c61d6493544b998c02fc90d70f4e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Creating volume 2c21616a-8661-4913-bec1-166f8c55d28f {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:28 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f 2147483648 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa21c426-eb65-49ba-9b4d-d4578c79ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1f4895-42fa-4220-b973-4ee653678300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:28 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Volume volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 (4189a27e-9cbc-4cb1-a450-fef09af4d9b3): created successfully Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1f4895-42fa-4220-b973-4ee653678300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (cbf32a23-1296-4392-937f-efd40199927f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:28 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e5cde914-db8e-474d-a5e6-0125ab9e128b tempest-GroupSnapshotsTest-1729284295 None] Created volume successfully. Apr 02 10:30:28 devstack sudo[85259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f 2147483648 Apr 02 10:30:28 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:29 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] GroupSnapshot f3baf6c6-de0b-49ff-b79e-051f7193ac48: creating. Apr 02 10:30:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Group snapshot f3baf6c6-de0b-49ff-b79e-051f7193ac48: creating. {{(pid=82391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 10:30:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:29 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f 2147483648" returned: 0 in 0.871s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:29 devstack sudo[85265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f Apr 02 10:30:29 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:30 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f" returned: 0 in 0.693s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.861s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53aca2a0-5ee1-4497-a780-b85cd38e2049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c21616a-8661-4913-bec1-166f8c55d28f', 'volume_size': 2}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e8b495-4207-45ef-8ca0-ea7bda5164ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Creating offline snapshot 97d1240f-256f-4863-abc5-6a09661b7e97 of volume 4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:30:30 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Volume volume-2c21616a-8661-4913-bec1-166f8c55d28f (2c21616a-8661-4913-bec1-166f8c55d28f): created successfully Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e8b495-4207-45ef-8ca0-ea7bda5164ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Flow 'volume_create_manager' (4f7eda59-7568-4b43-bdbf-43ec92bcf9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[700e2dee-9f75-45ae-b2e5-4b93d8431ebf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f941d9b0-f846-41a5-81ee-62ec42699ea8 tempest-VolumesCloneNegativeTest-998474496 None] Created volume successfully. Apr 02 10:30:30 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:30 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Acquiring lock "cinder-2c21616a-8661-4913-bec1-166f8c55d28f-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Lock "cinder-2c21616a-8661-4913-bec1-166f8c55d28f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Acquiring lock "cinder-quobyte-2c21616a-8661-4913-bec1-166f8c55d28f" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Lock "cinder-quobyte-2c21616a-8661-4913-bec1-166f8c55d28f" acquired by "delete_volume" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e326a-5fe4-48fe-8b03-8d2d93d45e28]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:31 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f Apr 02 10:30:31 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:31 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 1.403s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:31 devstack sudo[85306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 1G Apr 02 10:30:31 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:32 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f" returned: 0 in 1.081s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:32 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f Apr 02 10:30:32 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:33 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 1G" returned: 0 in 1.204s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:33 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 Apr 02 10:30:33 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:33 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2c21616a-8661-4913-bec1-166f8c55d28f" returned: 0 in 0.708s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Lock "cinder-quobyte-2c21616a-8661-4913-bec1-166f8c55d28f" released by "delete_volume" :: held 1.976s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Created reservations ['d0ccc739-0b7c-4f53-8f46-2b771c644a5c', '7c693622-3888-47e3-9a60-9176fb7c3239', 'e5d73b46-7f76-4442-b696-315f5b216176', '006a6019-4f8a-48b3-b4f8-0c811ad6af38'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:33 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:33 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:34 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97" returned: 0 in 1.085s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:34 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:34 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 Apr 02 10:30:34 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:34 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.169s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:34 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Deleted volume successfully. Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fdf086c7-9b87-493c-9991-7b723a321cb3 tempest-VolumesCloneNegativeTest-998474496 None] Lock "cinder-2c21616a-8661-4913-bec1-166f8c55d28f-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:34 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97" returned: 0 in 0.704s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:34 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info Apr 02 10:30:34 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:35 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info" returned: 0 in 0.979s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:35 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:30:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:35 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info Apr 02 10:30:35 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:36 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.info" returned: 0 in 1.040s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.639s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-08d22991-7741-43ed-99f2-f6b7bb0b6ef2 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot f3baf6c6-de0b-49ff-b79e-051f7193ac48: created successfully Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (dd09b7f5-2808-4a4c-a2c5-556924f0dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c980a7b3-e55b-4eed-9bbe-5693cd9b6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c980a7b3-e55b-4eed-9bbe-5693cd9b6536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-723835520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:38Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6873c5-9b95-4f03-80c5-413350341b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6873c5-9b95-4f03-80c5-413350341b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc55a2d-5146-44ba-b70d-2a8e6f3049cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc55a2d-5146-44ba-b70d-2a8e6f3049cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb', 'volume_name': 'volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edef7e7f-a6d1-4b2f-a84f-7777ea30914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edef7e7f-a6d1-4b2f-a84f-7777ea30914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5495b7b5-b365-4934-b122-42ce0189eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:38 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Volume 9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb', 'volume_size': 1} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-723835520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:38Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Creating volume 9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:38 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:38 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb 1073741824 Apr 02 10:30:38 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:40 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb 1073741824" returned: 0 in 2.005s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:40 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb Apr 02 10:30:40 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:40 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb" returned: 0 in 0.586s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.660s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.790s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-97d1240f-256f-4863-abc5-6a09661b7e97-c09fabe8-3484-4515-9fb1-b9274fdb0a36" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5495b7b5-b365-4934-b122-42ce0189eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2b3c75-bb40-44b9-a274-b00a73a89c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-97d1240f-256f-4863-abc5-6a09661b7e97-c09fabe8-3484-4515-9fb1-b9274fdb0a36" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Creating volume c09fabe8-3484-4515-9fb1-b9274fdb0a36 from snapshot 97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-c09fabe8-3484-4515-9fb1-b9274fdb0a36" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:40 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Volume volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb (9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb): created successfully Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2b3c75-bb40-44b9-a274-b00a73a89c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (dd09b7f5-2808-4a4c-a2c5-556924f0dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-c09fabe8-3484-4515-9fb1-b9274fdb0a36" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] snapshot: 97d1240f-256f-4863-abc5-6a09661b7e97, volume: c09fabe8-3484-4515-9fb1-b9274fdb0a36, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:30:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-451cd151-a05b-473e-a517-1b727d77cf14 tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15b590-ac67-4c7a-bf87-f78762d05c7a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:41 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 Apr 02 10:30:41 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:41 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97" returned: 0 in 0.712s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:30:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:30:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:30:41 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3004daa5-c060-428d-979f-dcadd4466fb0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:41 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:41 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (68b7404d-260a-49aa-a56e-ab1776020d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bee187-cd3e-47e2-8650-162a9eb86ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bee187-cd3e-47e2-8650-162a9eb86ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-609859389',display_name='tempest-VolumesGetTest-Volume-775552124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905c2db5-3f22-4663-ae91-a4649348784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:42Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a6c224-cc60-49c5-8196-e927f732193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a6c224-cc60-49c5-8196-e927f732193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e34460-3b33-4b8f-b66f-8fb770e23fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e34460-3b33-4b8f-b66f-8fb770e23fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905c2db5-3f22-4663-ae91-a4649348784f', 'volume_name': 'volume-905c2db5-3f22-4663-ae91-a4649348784f', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd013df-77e4-441a-aac7-e2c0ac941b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd013df-77e4-441a-aac7-e2c0ac941b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b476b49b-a11d-49a7-a899-718e9fa91f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:42 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Volume 905c2db5-3f22-4663-ae91-a4649348784f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905c2db5-3f22-4663-ae91-a4649348784f', 'volume_size': 1} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:42 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 0.695s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:30:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:42 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 Apr 02 10:30:42 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-883422c8-6539-407f-b7b8-aa8a0b1e8f08 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Terminate volume connection completed successfully. Apr 02 10:30:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-883422c8-6539-407f-b7b8-aa8a0b1e8f08 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Deleting attachment a6ae8ba9-e9c9-4e6d-8e99-78a4181789d3. {{(pid=82391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 10:30:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "cinder-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "cinder-quobyte-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-quobyte-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" acquired by "delete_volume" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74164f0-d1a0-459b-b4c4-bbfc45331f25]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:45 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:45 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:46 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36" returned: 0 in 3.835s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e5d466-4a8b-4ec2-bdc4-e9c44f96e0ed]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:46 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:46 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:46 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:46 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:46 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 0 in 1.929s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:46 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:46 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:47 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.850s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:47 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 1.366s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:30:47 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Converted 1024.00 MB image at 266.92 MB/s Apr 02 10:30:47 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:47 devstack sudo[85516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 Apr 02 10:30:47 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:47 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 1 in 1.073s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:30:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:47 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4 Apr 02 10:30:47 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:48 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:48 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-c09fabe8-3484-4515-9fb1-b9274fdb0a36" released by "_copy_volume_from_snapshot" :: held 7.266s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-97d1240f-256f-4863-abc5-6a09661b7e97-c09fabe8-3484-4515-9fb1-b9274fdb0a36" released by "_create_volume_from_snapshot" :: held 7.320s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.348s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.032s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-609859389',display_name='tempest-VolumesGetTest-Volume-775552124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905c2db5-3f22-4663-ae91-a4649348784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:42Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Creating volume 905c2db5-3f22-4663-ae91-a4649348784f {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:48 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" returned: 0 in 0.534s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:48 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f 1073741824 Apr 02 10:30:48 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-quobyte-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4" released by "delete_volume" :: held 3.697s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-de765f0d-a00d-42a4-8d68-734c22bb4fb6 tempest-GroupSnapshotsTest-1729284295 None] Create group from source-snapshot-f3baf6c6-de0b-49ff-b79e-051f7193ac48 completed successfully. Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.quota [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Created reservations ['0dac3c09-a5b8-40a4-a221-65b2f268ad2d', '5a4dbf35-a83f-4759-bae6-abc93df8e9ee', '54f0c0ae-e015-474c-8226-8fe954d6ac6a', 'd10a6919-751a-400e-be10-ec9a034860ea'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:48 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:48 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:49 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f 1073741824" returned: 0 in 0.937s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:49 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f Apr 02 10:30:49 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:49 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.828s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG cinder.manager [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:49 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Deleted volume successfully. Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-a542850b-9eb0-47b1-b06d-d9b960cae1ba req-934730e7-8b67-4dcf-8bd4-5369abe4cacd tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-faac1295-c09e-4cc1-bdc0-7b1d74cdaad4-delete_volume" released by "delete_volume" :: held 4.869s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-c09fabe8-3484-4515-9fb1-b9274fdb0a36" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-c09fabe8-3484-4515-9fb1-b9274fdb0a36" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b21b78d-83ae-41ad-bdb9-0e1f06dd5be3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:49 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 Apr 02 10:30:49 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:50 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f" returned: 0 in 0.859s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b476b49b-a11d-49a7-a899-718e9fa91f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905c2db5-3f22-4663-ae91-a4649348784f', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a1ab88-41d0-41d8-ab57-a88a33aec334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Volume volume-905c2db5-3f22-4663-ae91-a4649348784f (905c2db5-3f22-4663-ae91-a4649348784f): created successfully Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a1ab88-41d0-41d8-ab57-a88a33aec334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (68b7404d-260a-49aa-a56e-ab1776020d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4ac1d97d-5bfb-4d09-b4a4-c4a1270a6e26 tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:30:50 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36" returned: 0 in 0.750s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:50 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36 Apr 02 10:30:50 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:51 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09fabe8-3484-4515-9fb1-b9274fdb0a36" returned: 0 in 0.734s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-c09fabe8-3484-4515-9fb1-b9274fdb0a36" released by "delete_volume" :: held 1.527s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=55,cinder:DELETE=8,cinder:SELECT=67,cinder:INSERT=21 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['fbe14bd8-a298-4b05-9a95-e8337569da19'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:51 devstack cinder-volume[82391]: WARNING cinder.quota [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1955612803 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1955612803, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:30:51 devstack cinder-volume[82391]: WARNING cinder.quota [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1955612803 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1955612803, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['c133eb88-406e-430e-9a6c-1746e4fa69e5', '2ae9dd9b-0fc0-4252-9d33-26349aee837b', 'feb3d323-ecde-4364-a7c3-874fc770acaa', '2d97e2b0-8952-44ec-aaf9-396ec3de3bf5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-905c2db5-3f22-4663-ae91-a4649348784f-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Lock "cinder-905c2db5-3f22-4663-ae91-a4649348784f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-905c2db5-3f22-4663-ae91-a4649348784f" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-905c2db5-3f22-4663-ae91-a4649348784f" acquired by "delete_volume" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46ec903-be6a-41a4-a5c8-379839a8f5cd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:51 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:51 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:52 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f Apr 02 10:30:52 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot f3baf6c6-de0b-49ff-b79e-051f7193ac48: deleting Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot f3baf6c6-de0b-49ff-b79e-051f7193ac48: deleting {{(pid=82391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-97d1240f-256f-4863-abc5-6a09661b7e97" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-97d1240f-256f-4863-abc5-6a09661b7e97" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Deleting offline snapshot 97d1240f-256f-4863-abc5-6a09661b7e97 of volume 4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] snapshot_file for this snap is: volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129a44e-1c7f-4b04-a6ba-109d6a34251e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:52 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 Apr 02 10:30:52 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:52 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f" returned: 0 in 1.162s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:53 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f Apr 02 10:30:53 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:53 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.295s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b4e5cb2e-3d87-426d-ab91-7da86780d564 tempest-GroupSnapshotsTest-1729284295 None] Delete group completed successfully. Apr 02 10:30:53 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97" returned: 0 in 0.810s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:30:53 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-905c2db5-3f22-4663-ae91-a4649348784f" returned: 0 in 0.469s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c8f2e9-c1cf-4720-a08d-387e9b9e5573]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-905c2db5-3f22-4663-ae91-a4649348784f" released by "delete_volume" :: held 1.758s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Created reservations ['92346efc-455e-4f04-914f-847a83232da1', '1f622062-6fed-4e88-a01f-09493d1e587e', 'f7cd709d-7cfa-4b20-8413-054f74fc1af5', '19abb0d1-7855-4e97-a6e9-63de268738b6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:53 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:53 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:53 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:53 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Lock "cinder-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb" acquired by "delete_volume" :: waited 0.028s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f814bd-b87b-48b6-88f3-c77bf91c8cfd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:54 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:54 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.733s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:54 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:54 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 0.877s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9ccd5b06-4e51-4fe3-b3da-98a43978eaa6 tempest-VolumesGetTest-423296423 None] Lock "cinder-905c2db5-3f22-4663-ae91-a4649348784f-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:54 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 Apr 02 10:30:54 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:54 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb" returned: 0 in 0.664s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:54 devstack sudo[85664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb Apr 02 10:30:54 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:55 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97" returned: 0 in 0.671s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:55 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97 Apr 02 10:30:55 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:55 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb" returned: 0 in 0.629s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb" released by "delete_volume" :: held 1.336s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Created reservations ['2644733e-301b-413d-a99f-4a06b228ed09', '1133265a-f967-43fc-b682-cd1842d8b67d', 'c66fb87d-bb88-45d5-8397-32e4fa90600e', 'f5ffdbb8-77af-4d54-8f9c-d48a309206f1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:55 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3.97d1240f-256f-4863-abc5-6a09661b7e97" returned: 0 in 0.543s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-97d1240f-256f-4863-abc5-6a09661b7e97" released by "_delete_snapshot" :: held 3.098s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" released by "delete_snapshot" :: held 3.127s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:55 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:55 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:55 devstack cinder-volume[82391]: WARNING cinder.quota [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1955612803 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1955612803, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:30:55 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['d950fcaf-2914-4e4f-8fa7-eb039e0d0ec7', 'e5af631f-dd86-4b92-8a67-ca42b659c2b7', '5a0477ec-8a70-4a92-8a22-977c6414eb89', 'f311efdf-2bfb-448f-95ba-dc01d2499ddc'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:55 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6d35dd0d-b577-4392-8eaa-8620b9e6cce1 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot f3baf6c6-de0b-49ff-b79e-051f7193ac48: deleted successfully Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" acquired by "delete_volume" :: waited 0.033s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277a607-cc2a-4fc7-b37e-adfd6d517cf4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:56 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:56 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:56 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.674s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-17e4d8b3-a34a-4117-97ae-b8dfbea55ce1 tempest-VolumesGetTest-423296423 None] Lock "cinder-9f9325e2-1abd-4b1d-96f2-86e9fbebbbdb-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (3031de69-9343-4275-8025-f0048c57014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f0be1e-aa91-4fb7-b95a-43bb464e6f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f0be1e-aa91-4fb7-b95a-43bb464e6f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1080233820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f270f354-c0fa-4fa1-a540-d25703ecdbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:57Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3dfb7c-17d1-48ea-89ee-bbd396d49f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3dfb7c-17d1-48ea-89ee-bbd396d49f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de50845e-3011-4ab7-8930-d352ed09a6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de50845e-3011-4ab7-8930-d352ed09a6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f270f354-c0fa-4fa1-a540-d25703ecdbea', 'volume_name': 'volume-f270f354-c0fa-4fa1-a540-d25703ecdbea', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdedfe2-9ad1-4c34-87d2-4b33717e7a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdedfe2-9ad1-4c34-87d2-4b33717e7a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec8fa90-30f9-4700-bf12-40b25d70952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:56 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Volume f270f354-c0fa-4fa1-a540-d25703ecdbea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f270f354-c0fa-4fa1-a540-d25703ecdbea', 'volume_size': 1} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1080233820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f270f354-c0fa-4fa1-a540-d25703ecdbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:57Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Creating volume f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:56 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:56 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea 1073741824 Apr 02 10:30:56 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:56 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 0.809s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:56 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3 Apr 02 10:30:56 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:57 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" returned: 0 in 0.510s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:57 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-4189a27e-9cbc-4cb1-a450-fef09af4d9b3" released by "delete_volume" :: held 1.373s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea 1073741824" returned: 0 in 0.670s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:57 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:30:57 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['57e1717d-a7d6-47f3-a263-87abdd6948f0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:57 devstack cinder-volume[82391]: WARNING cinder.db.sqlalchemy.api [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1955612803'] Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['ed8d6cf4-85bf-4a6f-860d-817f122dc803', '5e9aaabe-3dad-409f-a847-6e7dfe4cbad6', '68ec352a-d0d4-47e3-b92f-f03f1497896b', '5f47aed7-2f5c-4eeb-a349-6b4778ca7875'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:57 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:30:57 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:58 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.886s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec8fa90-30f9-4700-bf12-40b25d70952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f270f354-c0fa-4fa1-a540-d25703ecdbea', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce6bb64-f3fb-43d0-b350-66449a9d1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:58 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Volume volume-f270f354-c0fa-4fa1-a540-d25703ecdbea (f270f354-c0fa-4fa1-a540-d25703ecdbea): created successfully Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce6bb64-f3fb-43d0-b350-66449a9d1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (3031de69-9343-4275-8025-f0048c57014a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0fb98c49-162e-4616-b9f0-5fc37b55171a tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:30:58 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.804s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:30:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-632c44a7-a61e-4d07-89fa-c4816ce980a3 tempest-GroupSnapshotsTest-1729284295 None] Delete group completed successfully. Apr 02 10:30:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4625315f-32ff-4b72-b400-4bb8c9ba1707 tempest-GroupSnapshotsTest-1729284295 None] Group tempest-GroupSnapshotsTest-Group-644895807: creating Apr 02 10:30:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4625315f-32ff-4b72-b400-4bb8c9ba1707 tempest-GroupSnapshotsTest-1729284295 None] Group tempest-GroupSnapshotsTest-Group-644895807: created successfully Apr 02 10:30:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4625315f-32ff-4b72-b400-4bb8c9ba1707 tempest-GroupSnapshotsTest-1729284295 None] Create group completed successfully. Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Flow 'volume_create_manager' (afc02e91-ff11-41b8-9d8d-e0cb56c822d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bdc9f2-c41a-4a14-8aa2-a063654ca643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bdc9f2-c41a-4a14-8aa2-a063654ca643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462602625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da19f0f-7424-4afc-907a-d3f2635fbafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bb4a08a3cd4569b04736e7cba2db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:59Z,use_quota=True,user_id='e8d52362a2b848d98292b4ee38a892b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54ab9de-b2f0-46e2-949e-a0c09b2f3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54ab9de-b2f0-46e2-949e-a0c09b2f3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ba95b-ce50-406a-aa25-beb5e2092f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ba95b-ce50-406a-aa25-beb5e2092f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da19f0f-7424-4afc-907a-d3f2635fbafa', 'volume_name': 'volume-6da19f0f-7424-4afc-907a-d3f2635fbafa', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9485a760-7ab4-439c-b2e9-e0e3fc56cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9485a760-7ab4-439c-b2e9-e0e3fc56cc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209e0c88-cd64-4f02-a968-920f56889f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Volume 6da19f0f-7424-4afc-907a-d3f2635fbafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da19f0f-7424-4afc-907a-d3f2635fbafa', 'volume_size': 1} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462602625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da19f0f-7424-4afc-907a-d3f2635fbafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bb4a08a3cd4569b04736e7cba2db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:59Z,use_quota=True,user_id='e8d52362a2b848d98292b4ee38a892b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Creating volume 6da19f0f-7424-4afc-907a-d3f2635fbafa {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:30:59 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:59 devstack sudo[85718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa 1073741824 Apr 02 10:30:59 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (9d0da2d4-67d2-42cd-aec8-cf294d70580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e90032e-14ed-4b8c-be79-659f8ac61a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e90032e-14ed-4b8c-be79-659f8ac61a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-560907032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba245f02-5597-492c-8352-a26fa3b7a8fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f270f354-c0fa-4fa1-a540-d25703ecdbea,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:59Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b1c71-69b9-4664-86e5-77e49f4621c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b1c71-69b9-4664-86e5-77e49f4621c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f75f6f-d940-4a4d-bc3b-3d959f532f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f75f6f-d940-4a4d-bc3b-3d959f532f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ba245f02-5597-492c-8352-a26fa3b7a8fe', 'volume_name': 'volume-ba245f02-5597-492c-8352-a26fa3b7a8fe', 'volume_size': 1, 'source_volid': 'f270f354-c0fa-4fa1-a540-d25703ecdbea', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935c7db3-95a8-46a0-990d-dc4f810fc7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935c7db3-95a8-46a0-990d-dc4f810fc7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bec32e-46d6-4316-94fc-7ee7640f7e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:30:59 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Volume ba245f02-5597-492c-8352-a26fa3b7a8fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ba245f02-5597-492c-8352-a26fa3b7a8fe', 'volume_size': 1, 'source_volid': 'f270f354-c0fa-4fa1-a540-d25703ecdbea', 'source_volstatus': 'available'} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:30:59 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa 1073741824" returned: 0 in 0.596s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:30:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:30:59 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa Apr 02 10:30:59 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (8d0dad67-ed2e-4390-882b-78f515bdca6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce019b52-3b4f-461a-9526-b09e66efbd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce019b52-3b4f-461a-9526-b09e66efbd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126955241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b243a12-2c67-4784-a436-e643a1a74121,host='devstack@QuobyteHD#QuobyteHD',id=bed2b4f7-5d34-4a64-a0d1-6827201ea330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:00Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579fc472-58a2-427e-a621-1ae999fd48ec),volume_type_id=579fc472-58a2-427e-a621-1ae999fd48ec)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c51f5c-6720-43f5-a2ed-5978c0208447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c51f5c-6720-43f5-a2ed-5978c0208447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b6607a-f34a-4119-89a2-d3dfb11dd0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b6607a-f34a-4119-89a2-d3dfb11dd0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed2b4f7-5d34-4a64-a0d1-6827201ea330', 'volume_name': 'volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eb9bdf-c487-44d5-b7c4-0a5562a9ca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eb9bdf-c487-44d5-b7c4-0a5562a9ca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401d91fa-4d82-4377-804b-fa4d05f6a1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:00 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Volume bed2b4f7-5d34-4a64-a0d1-6827201ea330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330', 'volume_size': 1} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:00 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa" returned: 0 in 0.745s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.150s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:00 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Cloning volume f270f354-c0fa-4fa1-a540-d25703ecdbea to volume ba245f02-5597-492c-8352-a26fa3b7a8fe Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209e0c88-cd64-4f02-a968-920f56889f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da19f0f-7424-4afc-907a-d3f2635fbafa', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf51cea-df56-4b03-95df-99a995bba631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-aaafaa1e-536c-4395-9a8a-4ba451764537 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Terminate volume connection completed successfully. Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-aaafaa1e-536c-4395-9a8a-4ba451764537 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Deleting attachment 6ef04094-e297-4ab3-bd8b-5cde66c6f453. {{(pid=82391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 02 10:31:00 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Volume volume-6da19f0f-7424-4afc-907a-d3f2635fbafa (6da19f0f-7424-4afc-907a-d3f2635fbafa): created successfully Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf51cea-df56-4b03-95df-99a995bba631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Flow 'volume_create_manager' (afc02e91-ff11-41b8-9d8d-e0cb56c822d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-03562561-eb93-46c1-967d-c7b02d9b1b5b tempest-ServersNegativeTestJSON-780139811 None] Created volume successfully. Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Creating offline snapshot d36af22b-2b4a-41fe-9357-4075527e8470 of volume f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cfaebe-efab-440c-9698-fd31b75162cf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:00 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:31:00 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "cinder-568b9488-47e3-4764-948d-8f9f2ac311bc-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-568b9488-47e3-4764-948d-8f9f2ac311bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "cinder-quobyte-568b9488-47e3-4764-948d-8f9f2ac311bc" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-quobyte-568b9488-47e3-4764-948d-8f9f2ac311bc" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e495a9-b340-42c9-82fc-acfc0111512f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:01 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.642s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:01 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc Apr 02 10:31:01 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:01 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 1G Apr 02 10:31:01 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:01 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc" returned: 0 in 0.704s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:01 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc Apr 02 10:31:01 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:02 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 1G" returned: 0 in 0.830s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f270f354-c0fa-4fa1-a540-d25703ecdbea -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:02 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f270f354-c0fa-4fa1-a540-d25703ecdbea -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 Apr 02 10:31:02 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Flow 'volume_create_manager' (1e65cffc-2efa-4ede-9017-d3ae7706b749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccb7b9a-d3d3-40a3-adf4-b7b83e09a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccb7b9a-d3d3-40a3-adf4-b7b83e09a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1314187415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904aca16-59c2-4b9b-99e0-96f65612115b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bb4a08a3cd4569b04736e7cba2db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:02Z,use_quota=True,user_id='e8d52362a2b848d98292b4ee38a892b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b63ce5-fb1a-48fd-9b09-ae193c9ce0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:02 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b63ce5-fb1a-48fd-9b09-ae193c9ce0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83357cb0-31b6-4f6f-8e85-31800f62d6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83357cb0-31b6-4f6f-8e85-31800f62d6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904aca16-59c2-4b9b-99e0-96f65612115b', 'volume_name': 'volume-904aca16-59c2-4b9b-99e0-96f65612115b', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b4657b-ddd2-470d-8f50-9211082cc545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b4657b-ddd2-470d-8f50-9211082cc545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7dce5c-ee09-4835-87f6-c7948e3a1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Volume 904aca16-59c2-4b9b-99e0-96f65612115b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904aca16-59c2-4b9b-99e0-96f65612115b', 'volume_size': 1} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-568b9488-47e3-4764-948d-8f9f2ac311bc" returned: 0 in 0.549s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-quobyte-568b9488-47e3-4764-948d-8f9f2ac311bc" released by "delete_volume" :: held 1.288s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.quota [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Created reservations ['d69cf16f-8229-454b-bb8d-4f1e9d410bfd', '52a3d6a8-21e1-4f75-8a30-e03a9e65087d', 'f31975b2-3d9a-417d-b02b-ad5a703d81e4', 'dcc9998a-0220-4d25-b12b-f7bd85506d4f'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:02 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:02 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:02 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f270f354-c0fa-4fa1-a540-d25703ecdbea -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470" returned: 0 in 0.743s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:02 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 is being set with open permissions: ugo+rw Apr 02 10:31:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:02 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 Apr 02 10:31:02 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:03 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.554s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG cinder.manager [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Deleted volume successfully. Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-965aa5f1-4c5a-4a85-9b46-b088ed5bead8 req-baee0320-7b6b-4b21-9550-66f3dfa58213 tempest-ServerBootFromVolumeStableRescueTest-1224328811 None] Lock "cinder-568b9488-47e3-4764-948d-8f9f2ac311bc-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:03 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470" returned: 0 in 0.517s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:03 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info Apr 02 10:31:03 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:03 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info" returned: 0 in 0.431s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:03 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info is being set with open permissions: ugo+rw Apr 02 10:31:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:03 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info Apr 02 10:31:03 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:04 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.info" returned: 0 in 0.453s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-ba245f02-5597-492c-8352-a26fa3b7a8fe" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-ba245f02-5597-492c-8352-a26fa3b7a8fe" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] snapshot: d36af22b-2b4a-41fe-9357-4075527e8470, volume: ba245f02-5597-492c-8352-a26fa3b7a8fe, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f11dda-395d-403a-ae3a-4fea7df76038]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:04 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 Apr 02 10:31:04 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:04 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470" returned: 0 in 0.523s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f270f354-c0fa-4fa1-a540-d25703ecdbea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e63c7e0-33ce-4b28-93b8-96f98b419926]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:04 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:31:04 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:05 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.548s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:05 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:31:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:05 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe Apr 02 10:31:05 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:08 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe" returned: 0 in 2.964s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a34542e-91bd-4125-afd7-796bbd88b579]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:08 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:31:08 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:09 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.725s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:31:09 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Converted 1024.00 MB image at 345.25 MB/s Apr 02 10:31:09 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe is being set with open permissions: ugo+rw Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:09 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe Apr 02 10:31:09 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:09 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-ba245f02-5597-492c-8352-a26fa3b7a8fe" released by "_copy_volume_from_snapshot" :: held 5.291s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-d36af22b-2b4a-41fe-9357-4075527e8470" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-d36af22b-2b4a-41fe-9357-4075527e8470" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Deleting offline snapshot d36af22b-2b4a-41fe-9357-4075527e8470 of volume f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] snapshot_file for this snap is: volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[073ea39f-eeb4-4c38-801a-549d5aa43497]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:09 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 Apr 02 10:31:09 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:10 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470" returned: 0 in 0.575s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f270f354-c0fa-4fa1-a540-d25703ecdbea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:31:10 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3772e3f-2938-468b-a58d-fdbe10c8c9ea]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:10 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:31:10 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:10 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:10 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 Apr 02 10:31:10 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:11 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470" returned: 0 in 0.536s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:11 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470 Apr 02 10:31:11 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:11 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea.d36af22b-2b4a-41fe-9357-4075527e8470" returned: 0 in 0.479s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-d36af22b-2b4a-41fe-9357-4075527e8470" released by "_delete_snapshot" :: held 2.210s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.306s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.340s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b243a12-2c67-4784-a436-e643a1a74121,created_at=2026-04-02T08:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-126955241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b243a12-2c67-4784-a436-e643a1a74121,host='devstack@QuobyteHD#QuobyteHD',id=bed2b4f7-5d34-4a64-a0d1-6827201ea330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:00Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579fc472-58a2-427e-a621-1ae999fd48ec),volume_type_id=579fc472-58a2-427e-a621-1ae999fd48ec)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Creating volume bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:11 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=138,cinder:SELECT=97,cinder:INSERT=21,cinder:DELETE=6 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bec32e-46d6-4316-94fc-7ee7640f7e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba245f02-5597-492c-8352-a26fa3b7a8fe', 'volume_size': 1, 'source_volid': 'f270f354-c0fa-4fa1-a540-d25703ecdbea', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:11 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 1073741824 Apr 02 10:31:11 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21835ad1-6591-4f28-8b2d-5af13303ba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:11 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Volume volume-ba245f02-5597-492c-8352-a26fa3b7a8fe (ba245f02-5597-492c-8352-a26fa3b7a8fe): created successfully Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21835ad1-6591-4f28-8b2d-5af13303ba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (9d0da2d4-67d2-42cd-aec8-cf294d70580d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:11 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-72ee9673-1331-44d3-b817-4b2e2ab40f79 tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:31:12 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 1073741824" returned: 0 in 0.805s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:12 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 Apr 02 10:31:12 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (fe543adc-0f84-4ff5-80a9-9b0f2ce08e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad67e0-3e8f-418e-842f-ccabe330dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad67e0-3e8f-418e-842f-ccabe330dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2026337088',display_name='tempest-VolumesGetTest-Volume-1358386686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd35568-3621-49b0-8573-2cf62f23f298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:13Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea3adf5-ddcf-4e01-995e-696530d992ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea3adf5-ddcf-4e01-995e-696530d992ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e00aeb6-7d01-4db1-a864-dacf10ca9b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e00aeb6-7d01-4db1-a864-dacf10ca9b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd35568-3621-49b0-8573-2cf62f23f298', 'volume_name': 'volume-dbd35568-3621-49b0-8573-2cf62f23f298', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa73e909-2934-4bd8-9cbd-498b00c1f626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa73e909-2934-4bd8-9cbd-498b00c1f626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18003d78-aba3-46f9-9fa4-5ffe1e7c1eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Volume dbd35568-3621-49b0-8573-2cf62f23f298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd35568-3621-49b0-8573-2cf62f23f298', 'volume_size': 1} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:13 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330" returned: 0 in 0.605s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.835s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1314187415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904aca16-59c2-4b9b-99e0-96f65612115b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bb4a08a3cd4569b04736e7cba2db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:02Z,use_quota=True,user_id='e8d52362a2b848d98292b4ee38a892b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Creating volume 904aca16-59c2-4b9b-99e0-96f65612115b {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:13 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401d91fa-4d82-4377-804b-fa4d05f6a1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1f8baa-6aae-415b-90b1-cbd80a1ec660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:13 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b 1073741824 Apr 02 10:31:13 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Volume volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 (bed2b4f7-5d34-4a64-a0d1-6827201ea330): created successfully Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1f8baa-6aae-415b-90b1-cbd80a1ec660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (8d0dad67-ed2e-4390-882b-78f515bdca6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d3942bdc-c2b5-40ba-b613-c773686be103 tempest-GroupSnapshotsTest-1729284295 None] Created volume successfully. Apr 02 10:31:13 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b 1073741824" returned: 0 in 0.686s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:14 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b Apr 02 10:31:14 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (81d8627f-a08c-46b5-9bab-199f28198623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546d6ea8-6ab2-4c3e-b0bc-db4c875ba474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546d6ea8-6ab2-4c3e-b0bc-db4c875ba474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339632992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b243a12-2c67-4784-a436-e643a1a74121,host='devstack@QuobyteHD#QuobyteHD',id=6590beb8-38d9-4220-a718-e64a8865c265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:14Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579fc472-58a2-427e-a621-1ae999fd48ec),volume_type_id=579fc472-58a2-427e-a621-1ae999fd48ec)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbc9786-2326-4aa2-a680-7d9ce01fe5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbc9786-2326-4aa2-a680-7d9ce01fe5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010f1f57-0cab-4800-ae1b-a152f792bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010f1f57-0cab-4800-ae1b-a152f792bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6590beb8-38d9-4220-a718-e64a8865c265', 'volume_name': 'volume-6590beb8-38d9-4220-a718-e64a8865c265', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdfed23-6ccd-49b2-9fb6-85fe12f5d0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdfed23-6ccd-49b2-9fb6-85fe12f5d0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba906a0-f5a0-47bf-8d38-755c491a1aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Volume 6590beb8-38d9-4220-a718-e64a8865c265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6590beb8-38d9-4220-a718-e64a8865c265', 'volume_size': 1} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:14 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b" returned: 0 in 0.525s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2026337088',display_name='tempest-VolumesGetTest-Volume-1358386686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd35568-3621-49b0-8573-2cf62f23f298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:13Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Creating volume dbd35568-3621-49b0-8573-2cf62f23f298 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:14 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7dce5c-ee09-4835-87f6-c7948e3a1fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904aca16-59c2-4b9b-99e0-96f65612115b', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:14 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 1073741824 Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3705ebe9-4e0f-4ea6-9ef1-d01f034ae28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:14 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Volume volume-904aca16-59c2-4b9b-99e0-96f65612115b (904aca16-59c2-4b9b-99e0-96f65612115b): created successfully Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3705ebe9-4e0f-4ea6-9ef1-d01f034ae28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Flow 'volume_create_manager' (1e65cffc-2efa-4ede-9017-d3ae7706b749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a39202e6-f96a-4137-ac4b-36ae1ce612bf tempest-ServersNegativeTestJSON-780139811 None] Created volume successfully. Apr 02 10:31:15 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 1073741824" returned: 0 in 0.649s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:15 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 Apr 02 10:31:15 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:15 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298" returned: 0 in 0.544s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b243a12-2c67-4784-a436-e643a1a74121,created_at=2026-04-02T08:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-339632992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b243a12-2c67-4784-a436-e643a1a74121,host='devstack@QuobyteHD#QuobyteHD',id=6590beb8-38d9-4220-a718-e64a8865c265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:14Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579fc472-58a2-427e-a621-1ae999fd48ec),volume_type_id=579fc472-58a2-427e-a621-1ae999fd48ec)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Creating volume 6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:15 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18003d78-aba3-46f9-9fa4-5ffe1e7c1eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd35568-3621-49b0-8573-2cf62f23f298', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:15 devstack sudo[85885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 1073741824 Apr 02 10:31:15 devstack sudo[85885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f93ccde-393c-4387-b227-acd69bb4ea65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:15 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Volume volume-dbd35568-3621-49b0-8573-2cf62f23f298 (dbd35568-3621-49b0-8573-2cf62f23f298): created successfully Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f93ccde-393c-4387-b227-acd69bb4ea65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (fe543adc-0f84-4ff5-80a9-9b0f2ce08e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-094e2b18-0c90-4819-b683-38cfda7ddfa3 tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "cinder-904aca16-59c2-4b9b-99e0-96f65612115b-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-904aca16-59c2-4b9b-99e0-96f65612115b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "cinder-quobyte-904aca16-59c2-4b9b-99e0-96f65612115b" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-quobyte-904aca16-59c2-4b9b-99e0-96f65612115b" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0517a9ea-bfaa-484a-bf1d-80e9e86c6222]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:16 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b Apr 02 10:31:16 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-dbd35568-3621-49b0-8573-2cf62f23f298-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Lock "cinder-dbd35568-3621-49b0-8573-2cf62f23f298-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-dbd35568-3621-49b0-8573-2cf62f23f298" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-dbd35568-3621-49b0-8573-2cf62f23f298" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517d97f-1f6b-4d8c-95a5-8e71694669ac]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:16 devstack sudo[85885]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 1073741824" returned: 0 in 0.883s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:16 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 Apr 02 10:31:16 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:16 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 Apr 02 10:31:16 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:16 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b" returned: 0 in 0.778s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:16 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b Apr 02 10:31:16 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:17 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265" returned: 0 in 0.519s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba906a0-f5a0-47bf-8d38-755c491a1aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6590beb8-38d9-4220-a718-e64a8865c265', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e51c8a6-2d16-45c4-9005-6bd17473eb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Volume volume-6590beb8-38d9-4220-a718-e64a8865c265 (6590beb8-38d9-4220-a718-e64a8865c265): created successfully Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e51c8a6-2d16-45c4-9005-6bd17473eb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (81d8627f-a08c-46b5-9bab-199f28198623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-600b060d-4dcd-4afd-a489-d5de683e1180 tempest-GroupSnapshotsTest-1729284295 None] Created volume successfully. Apr 02 10:31:17 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298" returned: 0 in 0.669s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:17 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298 Apr 02 10:31:17 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:17 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-904aca16-59c2-4b9b-99e0-96f65612115b" returned: 0 in 0.526s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-quobyte-904aca16-59c2-4b9b-99e0-96f65612115b" released by "delete_volume" :: held 1.351s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Created reservations ['901f6a5e-38d3-4570-93df-cebdd72c047e', 'd6b8f6bf-eea6-43de-b942-028e831c1bf9', '29b24c69-b571-4443-a611-315c85ecd578', '9b2a061b-4167-4dfe-b299-b3c859376457'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e56e1412-f207-4971-b235-0204c2b001b7 tempest-GroupSnapshotsTest-1729284295 None] Update group completed successfully. Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:17 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:17 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:17 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dbd35568-3621-49b0-8573-2cf62f23f298" returned: 0 in 0.622s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-dbd35568-3621-49b0-8573-2cf62f23f298" released by "delete_volume" :: held 1.320s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:17 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Created reservations ['a9b8ab77-4ef0-4051-95a5-41cae958fd92', '6b35909e-ac66-49f0-b654-a8a009b93c03', '2cb5d21c-146b-4de7-9275-5a8da44b6b8a', '30597ef4-c5db-4248-83e7-70a619e7f924'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:18 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:18 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:18 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.551s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Deleted volume successfully. Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7b2eeef3-8daf-4560-9e45-0af2152b5b24 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-904aca16-59c2-4b9b-99e0-96f65612115b-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "cinder-6da19f0f-7424-4afc-907a-d3f2635fbafa-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-6da19f0f-7424-4afc-907a-d3f2635fbafa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "cinder-quobyte-6da19f0f-7424-4afc-907a-d3f2635fbafa" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-quobyte-6da19f0f-7424-4afc-907a-d3f2635fbafa" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e91384f-913b-4df1-94de-5710fa1a65d8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:18 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa Apr 02 10:31:18 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:18 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.523s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9293c977-195a-4b52-b982-28af40a9d948 tempest-VolumesGetTest-423296423 None] Lock "cinder-dbd35568-3621-49b0-8573-2cf62f23f298-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Flow 'volume_create_manager' (382b4f5d-8109-4d13-b581-ec54a8212dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ec576b-50f8-4e2b-a3db-b671aee0b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ec576b-50f8-4e2b-a3db-b671aee0b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-871721936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63d62e-559a-4cba-a2b7-8ece55076b30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fdff4133bf4debaee0dbb93e6372ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:19Z,use_quota=True,user_id='a767b7ff9e254726b5c626ca1f3f26d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d50a13-da81-447d-92db-5b76087ba0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d50a13-da81-447d-92db-5b76087ba0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dce62f-433f-4467-bb21-4d08873b5828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dce62f-433f-4467-bb21-4d08873b5828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b63d62e-559a-4cba-a2b7-8ece55076b30', 'volume_name': 'volume-7b63d62e-559a-4cba-a2b7-8ece55076b30', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28de732f-d2c7-49e0-b8f3-1ccd98dc028c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28de732f-d2c7-49e0-b8f3-1ccd98dc028c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862eac5b-4d33-4556-b48a-b6d43e96543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:18 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Volume 7b63d62e-559a-4cba-a2b7-8ece55076b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b63d62e-559a-4cba-a2b7-8ece55076b30', 'volume_size': 1} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-871721936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63d62e-559a-4cba-a2b7-8ece55076b30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fdff4133bf4debaee0dbb93e6372ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:19Z,use_quota=True,user_id='a767b7ff9e254726b5c626ca1f3f26d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Creating volume 7b63d62e-559a-4cba-a2b7-8ece55076b30 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:18 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:18 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 1073741824 Apr 02 10:31:18 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-69527ae0-e3cc-4d81-9a59-356db0914c5d tempest-GroupSnapshotsTest-1729284295 None] Update group completed successfully. Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-ba245f02-5597-492c-8352-a26fa3b7a8fe-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Lock "cinder-ba245f02-5597-492c-8352-a26fa3b7a8fe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-ba245f02-5597-492c-8352-a26fa3b7a8fe" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-ba245f02-5597-492c-8352-a26fa3b7a8fe" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84b2248-26a6-4002-a468-a0a141fe89cc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:18 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa" returned: 0 in 0.596s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:18 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa Apr 02 10:31:18 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:19 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe Apr 02 10:31:19 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:19 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 1073741824" returned: 0 in 0.602s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:19 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 Apr 02 10:31:19 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:19 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6da19f0f-7424-4afc-907a-d3f2635fbafa" returned: 0 in 0.447s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-quobyte-6da19f0f-7424-4afc-907a-d3f2635fbafa" released by "delete_volume" :: held 1.075s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Created reservations ['76233158-ad1d-4501-8292-3917f5f712e1', '4e858a8d-b79c-4b9b-a016-09d4118589a0', 'd9c85d63-a1f8-4926-a500-72645f5bf225', 'd78505c0-45d8-4e1b-ba41-dc46429b41b1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:19 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:19 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:19 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe" returned: 0 in 0.620s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:19 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe Apr 02 10:31:19 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:19 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30" returned: 0 in 0.469s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862eac5b-4d33-4556-b48a-b6d43e96543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b63d62e-559a-4cba-a2b7-8ece55076b30', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edce219-7660-4f2b-8917-4501d7bf900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:19 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Volume volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 (7b63d62e-559a-4cba-a2b7-8ece55076b30): created successfully Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edce219-7660-4f2b-8917-4501d7bf900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Flow 'volume_create_manager' (382b4f5d-8109-4d13-b581-ec54a8212dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-fe81a3de-f7fe-4f01-9e33-07e82856ae41 req-6000a86e-a03b-418a-9eee-003b169b5b45 tempest-VolumesGetTestJSON-1425860213 None] Created volume successfully. Apr 02 10:31:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8bc128ed-566b-4c12-ba9a-b907b2676b99 tempest-GroupSnapshotsTest-1729284295 None] Update group completed successfully. Apr 02 10:31:20 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.505s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:20 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Deleted volume successfully. Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d73ef969-fbf3-49a1-8a49-d71cfb21cbb8 tempest-ServersNegativeTestJSON-780139811 None] Lock "cinder-6da19f0f-7424-4afc-907a-d3f2635fbafa-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:20 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ba245f02-5597-492c-8352-a26fa3b7a8fe" returned: 0 in 0.502s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-ba245f02-5597-492c-8352-a26fa3b7a8fe" released by "delete_volume" :: held 1.148s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Created reservations ['3f55770d-3adb-402f-a481-669e91b6a534', '93d41fff-cca3-4273-b2ae-d207e50a219b', '0cd524bf-8e74-45bf-be9e-15a878e52a02', '48931d97-dc5b-4139-968e-0f0fc9a7214d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:20 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:20 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:20 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:20 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0c56b4b7-fc6d-42ad-a1c0-4faf6689ca0c tempest-VolumesGetTest-423296423 None] Lock "cinder-ba245f02-5597-492c-8352-a26fa3b7a8fe-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Acquiring lock "cinder-7b63d62e-559a-4cba-a2b7-8ece55076b30-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Lock "cinder-7b63d62e-559a-4cba-a2b7-8ece55076b30-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Acquiring lock "cinder-quobyte-7b63d62e-559a-4cba-a2b7-8ece55076b30" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Lock "cinder-quobyte-7b63d62e-559a-4cba-a2b7-8ece55076b30" acquired by "delete_volume" :: waited 0.040s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa52dec-af9a-44d3-a2b8-9aa44df7af3e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-da19ed4a-8b8b-42db-a249-21a97f05abb8 tempest-GroupSnapshotsTest-1729284295 None] Update group completed successfully. Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-f270f354-c0fa-4fa1-a540-d25703ecdbea-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Lock "cinder-f270f354-c0fa-4fa1-a540-d25703ecdbea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-f270f354-c0fa-4fa1-a540-d25703ecdbea" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:21 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 Apr 02 10:31:21 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-f270f354-c0fa-4fa1-a540-d25703ecdbea" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b95e673-a78a-4ed5-8453-5ca7f2b3126f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:21 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:31:21 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:21 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30" returned: 0 in 0.523s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:21 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30 Apr 02 10:31:21 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:21 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.582s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:21 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea Apr 02 10:31:21 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:22 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b63d62e-559a-4cba-a2b7-8ece55076b30" returned: 0 in 0.711s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Lock "cinder-quobyte-7b63d62e-559a-4cba-a2b7-8ece55076b30" released by "delete_volume" :: held 1.278s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.quota [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Created reservations ['361e9499-61b9-490d-88f0-b508523728c2', 'f16e6b51-de12-4b07-b840-71a11ea1eeba', 'de07f0a0-406f-4561-925a-2a25794f006f', '6a2a50e6-0c50-4f66-8a31-a98412b48bcb'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] GroupSnapshot 8b6a30a4-5898-44ed-9f31-951d3c2817a5: creating. Apr 02 10:31:22 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:22 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Group snapshot 8b6a30a4-5898-44ed-9f31-951d3c2817a5: creating. {{(pid=82391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:22 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Creating offline snapshot b77bb9f6-0af7-483d-b14d-83112e152ae4 of volume 6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f270f354-c0fa-4fa1-a540-d25703ecdbea" returned: 0 in 0.804s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb46981-6b3e-4bd2-97f0-db4c5d679e9e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-f270f354-c0fa-4fa1-a540-d25703ecdbea" released by "delete_volume" :: held 1.445s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Created reservations ['03166197-eafe-4415-b550-3825752e6b18', '48f4b565-0e07-4787-a414-bc71f3913ff3', '49c8b6a7-9450-49f3-b4e2-ff425a10fdc5', '1fc2401a-c342-482c-9b98-9337d23c021d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:22 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 Apr 02 10:31:22 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:22 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:22 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:23 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.556s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG cinder.manager [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Deleted volume successfully. Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-4d9c76ed-7cda-4293-930d-2669c17d353b req-b76e029c-6e82-457d-9ad7-780f53732dbb tempest-VolumesGetTestJSON-1425860213 None] Lock "cinder-7b63d62e-559a-4cba-a2b7-8ece55076b30-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:23 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265" returned: 0 in 0.697s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:23 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 1G Apr 02 10:31:23 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:23 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.620s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:31:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-859cbd2b-9bb9-4f7d-94c4-fd71e816d896 tempest-VolumesGetTest-423296423 None] Lock "cinder-f270f354-c0fa-4fa1-a540-d25703ecdbea-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (8e8656bd-617e-40ca-a3d5-2ed8ff3cf42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1482ef-f8f3-459d-84d6-780c7ae16962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1482ef-f8f3-459d-84d6-780c7ae16962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1645456491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca20a683-df3f-4b31-8b66-fafad842974c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:24Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac3093a-3432-43cc-a121-88696b1e105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac3093a-3432-43cc-a121-88696b1e105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400492e5-357e-475a-91bb-43374cfc4255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.image.glance [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Creating Keystone auth plugin from conf {{(pid=82391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 10:31:24 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 1G" returned: 0 in 0.779s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6590beb8-38d9-4220-a718-e64a8865c265 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:24 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6590beb8-38d9-4220-a718-e64a8865c265 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 Apr 02 10:31:24 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400492e5-357e-475a-91bb-43374cfc4255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca20a683-df3f-4b31-8b66-fafad842974c', 'volume_name': 'volume-ca20a683-df3f-4b31-8b66-fafad842974c', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcfe35b-a925-4930-addc-180c8ef904bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcfe35b-a925-4930-addc-180c8ef904bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475ef8a6-91c3-40d7-8e34-f92bde25e32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:24 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Volume ca20a683-df3f-4b31-8b66-fafad842974c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca20a683-df3f-4b31-8b66-fafad842974c', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Trying to clone ca20a683-df3f-4b31-8b66-fafad842974c from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d at location (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]). {{(pid=82391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 10:31:24 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Image download 20.69 MB at 20.69 MB/s Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a416314-aa8f-4f34-9e52-bd2aab33fd7f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:24 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6590beb8-38d9-4220-a718-e64a8865c265 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4" returned: 0 in 0.506s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:24 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:31:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:24 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 Apr 02 10:31:24 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:24 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD Apr 02 10:31:24 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:25 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4" returned: 0 in 0.531s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:25 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info Apr 02 10:31:25 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:25 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD" returned: 0 in 0.657s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d is fetched for user 14945bb441af4f43ac60a5c854d79b4f. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacb8c5d-8fac-436a-963c-88232ed6339e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:25 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD Apr 02 10:31:25 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:25 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info" returned: 0 in 0.525s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:25 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:25 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info Apr 02 10:31:25 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:25 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD" returned: 0 in 0.564s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:26 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.info" returned: 0 in 0.522s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.629s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Creating offline snapshot d395c4b1-595c-4d7e-bc00-229fb6ca8028 of volume bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fde3a12-e0f9-4ff2-ba9a-aefdda69c558]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:26 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 Apr 02 10:31:26 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:26 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330" returned: 0 in 0.590s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:26 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 1G Apr 02 10:31:26 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:27 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 1G" returned: 0 in 0.714s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:27 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 Apr 02 10:31:27 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:28 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:28 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:31:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:28 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 Apr 02 10:31:28 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:28 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028" returned: 0 in 0.544s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:28 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info Apr 02 10:31:28 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:29 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info" returned: 0 in 0.576s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:29 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:29 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info Apr 02 10:31:29 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:29 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.info" returned: 0 in 0.675s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.739s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.100s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1645456491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca20a683-df3f-4b31-8b66-fafad842974c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:24Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Creating volume ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:29 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:30 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c 1073741824 Apr 02 10:31:30 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-52fef2b6-579e-43c4-98bc-d0729df7e719 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 8b6a30a4-5898-44ed-9f31-951d3c2817a5: created successfully Apr 02 10:31:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ce71a75f-84ff-4e6b-bcc6-10ad4974e8d0 tempest-GroupsTest-665551612 None] Group tempest-Group1-1628765958: creating Apr 02 10:31:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ce71a75f-84ff-4e6b-bcc6-10ad4974e8d0 tempest-GroupsTest-665551612 None] Group tempest-Group1-1628765958: created successfully Apr 02 10:31:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ce71a75f-84ff-4e6b-bcc6-10ad4974e8d0 tempest-GroupsTest-665551612 None] Create group completed successfully. Apr 02 10:31:30 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c 1073741824" returned: 0 in 0.872s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:30 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:30 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:31 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 8b6a30a4-5898-44ed-9f31-951d3c2817a5: deleting Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 8b6a30a4-5898-44ed-9f31-951d3c2817a5: deleting {{(pid=82391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-6590beb8-38d9-4220-a718-e64a8865c265" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-6590beb8-38d9-4220-a718-e64a8865c265" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-b77bb9f6-0af7-483d-b14d-83112e152ae4" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-b77bb9f6-0af7-483d-b14d-83112e152ae4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Deleting offline snapshot b77bb9f6-0af7-483d-b14d-83112e152ae4 of volume 6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] snapshot_file for this snap is: volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abc244d-eaed-4298-95ff-4069826b907f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:31 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 Apr 02 10:31:31 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:31 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 0 in 0.676s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Attempting download of 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume ca20a683-df3f-4b31-8b66-fafad842974c. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2d549-8e93-4659-a93b-d3ac0cd8fb07]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:31 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39 Apr 02 10:31:31 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:31 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4" returned: 0 in 0.622s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6590beb8-38d9-4220-a718-e64a8865c265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc10c42-256f-4de9-beea-0ad3db08c002]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:32 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 Apr 02 10:31:32 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:32 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1e86330f-cecc-48ce-a764-35180e01f2c3 tempest-GroupsTest-665551612 None] Group tempest-Group2-321701278: creating Apr 02 10:31:32 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1e86330f-cecc-48ce-a764-35180e01f2c3 tempest-GroupsTest-665551612 None] Group tempest-Group2-321701278: created successfully Apr 02 10:31:32 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1e86330f-cecc-48ce-a764-35180e01f2c3 tempest-GroupsTest-665551612 None] Create group completed successfully. Apr 02 10:31:32 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39" returned: 0 in 0.584s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:32 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39 Apr 02 10:31:32 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:32 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265" returned: 0 in 0.681s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:32 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 Apr 02 10:31:32 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:32 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39" returned: 1 in 0.654s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fnkszz39' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5599530-75ff-4fac-ac7b-413acfe0092d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:33 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD Apr 02 10:31:33 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:33 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4" returned: 0 in 0.653s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:33 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4 Apr 02 10:31:33 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:33 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] 25308ee5-ba0c-42b9-8fcd-f0100169d78d was qcow2, converting to raw {{(pid=82391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:33 devstack sudo[86134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:33 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Flow 'volume_create_manager' (db5e39fb-462b-4869-913a-4a29a6eb29c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbb7664-ad53-4c85-b151-c0cada3234fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbb7664-ad53-4c85-b151-c0cada3234fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2118719238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54909ad1-4120-4878-b462-a13568fa03f7,host='devstack@QuobyteHD#QuobyteHD',id=a4300e55-089e-49be-9d43-f800260f3462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a487a50bd06463db3bc0067c45b8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:34Z,use_quota=True,user_id='1feb56af22c54e04ad64725d9f95de33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f3fc873-e90c-49d7-8127-7f9d18b69e32),volume_type_id=8f3fc873-e90c-49d7-8127-7f9d18b69e32)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ead164-1f66-448d-afaa-1386c76c6fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ead164-1f66-448d-afaa-1386c76c6fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7a0340-3baf-4192-bb18-cfacc18020b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7a0340-3baf-4192-bb18-cfacc18020b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4300e55-089e-49be-9d43-f800260f3462', 'volume_name': 'volume-a4300e55-089e-49be-9d43-f800260f3462', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc30705-e5dc-47d2-ae5c-76e6b2c8d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc30705-e5dc-47d2-ae5c-76e6b2c8d564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d2c08e-855d-4f6e-ad1c-4315ebae645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:33 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Volume a4300e55-089e-49be-9d43-f800260f3462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4300e55-089e-49be-9d43-f800260f3462', 'volume_size': 1} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54909ad1-4120-4878-b462-a13568fa03f7,created_at=2026-04-02T08:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2118719238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54909ad1-4120-4878-b462-a13568fa03f7,host='devstack@QuobyteHD#QuobyteHD',id=a4300e55-089e-49be-9d43-f800260f3462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a487a50bd06463db3bc0067c45b8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:34Z,use_quota=True,user_id='1feb56af22c54e04ad64725d9f95de33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f3fc873-e90c-49d7-8127-7f9d18b69e32),volume_type_id=8f3fc873-e90c-49d7-8127-7f9d18b69e32)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Creating volume a4300e55-089e-49be-9d43-f800260f3462 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:33 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:33 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 1073741824 Apr 02 10:31:33 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:33 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265.b77bb9f6-0af7-483d-b14d-83112e152ae4" returned: 0 in 0.655s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-b77bb9f6-0af7-483d-b14d-83112e152ae4" released by "_delete_snapshot" :: held 2.706s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-6590beb8-38d9-4220-a718-e64a8865c265" released by "delete_snapshot" :: held 2.724s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-bed2b4f7-5d34-4a64-a0d1-6827201ea330" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-bed2b4f7-5d34-4a64-a0d1-6827201ea330" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-d395c4b1-595c-4d7e-bc00-229fb6ca8028" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-d395c4b1-595c-4d7e-bc00-229fb6ca8028" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Deleting offline snapshot d395c4b1-595c-4d7e-bc00-229fb6ca8028 of volume bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] snapshot_file for this snap is: volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[432c3380-c770-47ac-98e1-202dd0721d2c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:34 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 Apr 02 10:31:34 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:34 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 1073741824" returned: 0 in 0.859s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:34 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 Apr 02 10:31:34 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:34 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028" returned: 0 in 0.844s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd3283-3798-4d31-890b-f4635aef8ec0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:34 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 0 in 1.295s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_fl2ky6o_devstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:31:34 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Converted 112.00 MB image at 86.37 MB/s Apr 02 10:31:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:34 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 Apr 02 10:31:34 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:34 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c 1G Apr 02 10:31:34 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:35 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Flow 'volume_create_manager' (ed4c2c15-c773-41da-8372-c23837611567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c923e8f-6ef9-449b-bb3f-f3cfa4f5867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462" returned: 0 in 0.592s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d2c08e-855d-4f6e-ad1c-4315ebae645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4300e55-089e-49be-9d43-f800260f3462', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd21492d-e6ee-45fb-895a-f860373326e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c923e8f-6ef9-449b-bb3f-f3cfa4f5867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-740929542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6019a0-61e0-4205-96f0-fec8e5893e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40e2795a41d470c8ba51d8b6a2d6d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:35Z,use_quota=True,user_id='1f0a59715cef43e3b04b668645ac97c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8284716b-5676-46c4-8bd0-a661c15c6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8284716b-5676-46c4-8bd0-a661c15c6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c34f6d-bc7f-4ed2-964e-df05f9728a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c34f6d-bc7f-4ed2-964e-df05f9728a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6019a0-61e0-4205-96f0-fec8e5893e97', 'volume_name': 'volume-1f6019a0-61e0-4205-96f0-fec8e5893e97', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6305b2fa-3efd-49a7-b010-6a30ae9ee7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6305b2fa-3efd-49a7-b010-6a30ae9ee7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1433bf26-555d-42c3-987c-ddc71620a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:35 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Volume 1f6019a0-61e0-4205-96f0-fec8e5893e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6019a0-61e0-4205-96f0-fec8e5893e97', 'volume_size': 1} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-740929542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6019a0-61e0-4205-96f0-fec8e5893e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40e2795a41d470c8ba51d8b6a2d6d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:35Z,use_quota=True,user_id='1f0a59715cef43e3b04b668645ac97c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Creating volume 1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:35 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:35 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Volume volume-a4300e55-089e-49be-9d43-f800260f3462 (a4300e55-089e-49be-9d43-f800260f3462): created successfully Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd21492d-e6ee-45fb-895a-f860373326e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:35 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 1073741824 Apr 02 10:31:35 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Flow 'volume_create_manager' (db5e39fb-462b-4869-913a-4a29a6eb29c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:35 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9d3f8134-14cd-439f-be58-61fd6962f730 tempest-GroupsTest-665551612 None] Created volume successfully. Apr 02 10:31:35 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c 1G" returned: 0 in 0.550s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e61d21-eeeb-4431-af64-679524341a5b]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:35 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330" returned: 0 in 0.662s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:35 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 Apr 02 10:31:35 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:35 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:35 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:35 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 1073741824" returned: 0 in 0.624s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:36 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 Apr 02 10:31:36 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:36 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 0 in 0.613s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:36 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028" returned: 0 in 0.661s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:36 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:36 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:36 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028 Apr 02 10:31:36 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Acquiring lock "cinder-quobyte-a4300e55-089e-49be-9d43-f800260f3462" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Lock "cinder-quobyte-a4300e55-089e-49be-9d43-f800260f3462" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee4b3f-1ef2-4431-b5bc-1fbb4f22fa64]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:36 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 Apr 02 10:31:36 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:36 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97" returned: 0 in 0.585s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1433bf26-555d-42c3-987c-ddc71620a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6019a0-61e0-4205-96f0-fec8e5893e97', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36011b86-4b6b-49c2-95a3-f1f52e622ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:36 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Volume volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 (1f6019a0-61e0-4205-96f0-fec8e5893e97): created successfully Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36011b86-4b6b-49c2-95a3-f1f52e622ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Flow 'volume_create_manager' (ed4c2c15-c773-41da-8372-c23837611567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:36 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-2af52dbf-ea55-4614-82c6-a8e9b2d263cc req-e1ed3d75-1213-4ad6-b30c-970f547bde97 tempest-VolumesSnapshotsTestJSON-1242004996 None] Created volume successfully. Apr 02 10:31:36 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330.d395c4b1-595c-4d7e-bc00-229fb6ca8028" returned: 0 in 0.547s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-d395c4b1-595c-4d7e-bc00-229fb6ca8028" released by "_delete_snapshot" :: held 2.780s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-bed2b4f7-5d34-4a64-a0d1-6827201ea330" released by "delete_snapshot" :: held 2.800s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:36 devstack cinder-volume[82391]: WARNING cinder.quota [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1886248516 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1886248516, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:36 devstack cinder-volume[82391]: WARNING cinder.quota [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1886248516 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1886248516, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:36 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['ce49937f-acfd-485d-919a-2586d27eda68', '7bc02b45-0684-4149-a31d-7e8e1b15e74e', '162f239a-7f71-4193-9417-371a68976353', '505778f5-34bf-44e9-a395-9772acfe3dfd'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 1 in 0.753s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Downloaded image 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume ca20a683-df3f-4b31-8b66-fafad842974c successfully. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d for user 14945bb441af4f43ac60a5c854d79b4f is deleted. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Marking volume ca20a683-df3f-4b31-8b66-fafad842974c as bootable. {{(pid=82391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Copying metadata from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d to ca20a683-df3f-4b31-8b66-fafad842974c. {{(pid=82391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Creating volume glance metadata for volume ca20a683-df3f-4b31-8b66-fafad842974c backed by image 25308ee5-ba0c-42b9-8fcd-f0100169d78d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475ef8a6-91c3-40d7-8e34-f92bde25e32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca20a683-df3f-4b31-8b66-fafad842974c', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a6b2b7-7c37-4813-8e6a-451f90303453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:37 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:37 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Volume volume-ca20a683-df3f-4b31-8b66-fafad842974c (ca20a683-df3f-4b31-8b66-fafad842974c): created successfully Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a6b2b7-7c37-4813-8e6a-451f90303453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (8e8656bd-617e-40ca-a3d5-2ed8ff3cf42d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462" returned: 0 in 0.702s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7d37d4cc-b7ba-44a1-b8a0-a3c3398a59cc tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:31:37 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462 Apr 02 10:31:37 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['aec3e20c-75bc-49e4-a99c-82dd353fde89', '988a59b2-be73-4104-95cd-8d95afd4f11e', 'e59905e8-17de-4d76-b5f4-387dccce4c28', '6f05a9bb-3536-434b-b717-e0909a902966'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9216214a-acc9-4b3c-90c6-00f3c14798c7 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 8b6a30a4-5898-44ed-9f31-951d3c2817a5: deleted successfully Apr 02 10:31:37 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a4300e55-089e-49be-9d43-f800260f3462" returned: 0 in 0.547s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Lock "cinder-quobyte-a4300e55-089e-49be-9d43-f800260f3462" released by "delete_volume" :: held 1.285s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Created reservations ['2b6b6eab-e6f8-4038-9755-acd6da3117b0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:37 devstack cinder-volume[82391]: WARNING cinder.quota [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1543030691 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1543030691, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:37 devstack cinder-volume[82391]: WARNING cinder.quota [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1543030691 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1543030691, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Creating offline snapshot 1d68d6d4-3823-4c09-a7bd-4617020fe6e9 of volume 1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30b03ba-4679-49c7-bd95-f5f17757e993]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Created reservations ['8a736eb5-dc98-484f-b10c-228274f5a00a', 'cf245be9-05d7-4b42-bb6b-f83a1e8eebdf', '7f45bb5f-30be-4df8-a9cf-c32dbfae430e', '462cb6c5-3e9f-45fa-a137-8c013c459350'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:37 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 Apr 02 10:31:37 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:38 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:38 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-6590beb8-38d9-4220-a718-e64a8865c265" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-6590beb8-38d9-4220-a718-e64a8865c265" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c3a676-df6a-4011-83dc-b9b17f4da41c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:38 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 Apr 02 10:31:38 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:38 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.563s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ca2d32a8-9062-4dbf-b35d-5db59f1d4be3 tempest-GroupsTest-665551612 None] Delete group completed successfully. Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (f480086b-aec2-41b9-8d44-19dab7779557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9ba15c-9fbb-4b26-9966-db51eaf3ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:38 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97" returned: 0 in 0.890s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9ba15c-9fbb-4b26-9966-db51eaf3ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-716112527',display_name='tempest-VolumesGetTest-Volume-132502425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca647cc-63e5-4f8f-9676-59cd4cc25e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:39Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bfc5c0-4858-4a80-b525-999e9c657422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bfc5c0-4858-4a80-b525-999e9c657422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:38 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 1G Apr 02 10:31:38 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dea7f2-6cb4-4632-88e1-3d80421ecc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02dea7f2-6cb4-4632-88e1-3d80421ecc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca647cc-63e5-4f8f-9676-59cd4cc25e51', 'volume_name': 'volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4164773d-0057-4271-92b1-3e727cbf563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4164773d-0057-4271-92b1-3e727cbf563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ea5fdb-91dc-4baf-83e8-aaaf38ff5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:38 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Volume aca647cc-63e5-4f8f-9676-59cd4cc25e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51', 'volume_size': 1} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Created reservations ['59d7ed9c-95bb-4207-bfc7-b26eb4ff40a5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:38 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:38 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:38 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265" returned: 0 in 0.736s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:38 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265 Apr 02 10:31:38 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:39 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 1G" returned: 0 in 0.639s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:39 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 Apr 02 10:31:39 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:39 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.566s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:39 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-bab0da1d-8016-43ad-8620-173293b4cb60 tempest-GroupsTest-665551612 None] Delete group completed successfully. Apr 02 10:31:39 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6590beb8-38d9-4220-a718-e64a8865c265" returned: 0 in 0.594s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-6590beb8-38d9-4220-a718-e64a8865c265" released by "delete_volume" :: held 1.375s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-bed2b4f7-5d34-4a64-a0d1-6827201ea330" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-bed2b4f7-5d34-4a64-a0d1-6827201ea330" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9b267-a546-47ff-81aa-ff7a74486420]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:39 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 Apr 02 10:31:39 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:39 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9" returned: 0 in 0.554s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:39 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 is being set with open permissions: ugo+rw Apr 02 10:31:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:39 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 Apr 02 10:31:39 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:40 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330" returned: 0 in 0.643s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:40 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330 Apr 02 10:31:40 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-dc664463-1cc3-4d51-ba99-02a66b4673c8 tempest-GroupsTest-665551612 None] Group tempest-GroupsTest-Group-354246592: creating Apr 02 10:31:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-dc664463-1cc3-4d51-ba99-02a66b4673c8 tempest-GroupsTest-665551612 None] Group tempest-GroupsTest-Group-354246592: created successfully Apr 02 10:31:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-dc664463-1cc3-4d51-ba99-02a66b4673c8 tempest-GroupsTest-665551612 None] Create group completed successfully. Apr 02 10:31:40 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9" returned: 0 in 0.521s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:40 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info Apr 02 10:31:40 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:40 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bed2b4f7-5d34-4a64-a0d1-6827201ea330" returned: 0 in 0.493s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-bed2b4f7-5d34-4a64-a0d1-6827201ea330" released by "delete_volume" :: held 1.175s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['1f8f7d93-6404-400c-bc01-9a7c9a0b4e22'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:40 devstack cinder-volume[82391]: WARNING cinder.quota [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1886248516 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1886248516, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['c39ffef3-b140-498b-9a64-e14c9a96d6ed', '4fa8b99a-f71e-452d-b530-32dcc7154f0b', '8968cae2-1305-444c-b3c3-6e417593d69b', '7c3f3a3c-0311-43f7-8131-2490a05305da'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['1d98aa0b-d8fe-44d2-836f-6366f83dbdc0', 'f754da71-aaf1-4279-b24c-2de09ea1376e', 'a1c77d0b-7d00-4405-814e-ff4a9ca44f67', '2a35715e-f126-46c1-b464-59586821f6e0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:40 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:40 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:40 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info" returned: 0 in 0.486s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:40 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info is being set with open permissions: ugo+rw Apr 02 10:31:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:40 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info Apr 02 10:31:40 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:41 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.509s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-243d42f8-35ea-4a98-b80f-5cad6b80f958 tempest-GroupSnapshotsTest-1729284295 None] Delete group completed successfully. Apr 02 10:31:41 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.info" returned: 0 in 0.567s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.755s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.761s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-716112527',display_name='tempest-VolumesGetTest-Volume-132502425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca647cc-63e5-4f8f-9676-59cd4cc25e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e81e6eb72649c98fc0d5c21ddd1d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:39Z,use_quota=True,user_id='14945bb441af4f43ac60a5c854d79b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Creating volume aca647cc-63e5-4f8f-9676-59cd4cc25e51 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-1c42a194-f1c8-4dca-a89b-c1002bd32a4b req-6b9cb852-9aa5-4b02-9745-a19fd2620352 tempest-VolumesSnapshotsTestJSON-1242004996 None] Create snapshot completed successfully Apr 02 10:31:41 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 1073741824 Apr 02 10:31:41 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Flow 'volume_create_manager' (8cb8c306-f348-47b0-97e3-e253c9f5da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc639d24-83d4-4ee3-8288-ea82485252e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc639d24-83d4-4ee3-8288-ea82485252e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1483153984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d07cc56a-c869-40a1-b84f-9362f600e7cb,host='devstack@QuobyteHD#QuobyteHD',id=23ce50a1-e12e-4dba-acf6-57c329bf1f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a487a50bd06463db3bc0067c45b8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:42Z,use_quota=True,user_id='1feb56af22c54e04ad64725d9f95de33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a806f8-839f-42bd-8135-8b975f8a60c9),volume_type_id=e4a806f8-839f-42bd-8135-8b975f8a60c9)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f4def4-10c4-4ab8-8697-a0dad5bb96d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f4def4-10c4-4ab8-8697-a0dad5bb96d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709474fb-ead7-4b1b-b54e-f08e88d67717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709474fb-ead7-4b1b-b54e-f08e88d67717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ce50a1-e12e-4dba-acf6-57c329bf1f41', 'volume_name': 'volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc9b36-e85d-4d6c-88db-047c81d9748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebc9b36-e85d-4d6c-88db-047c81d9748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75536c17-747c-4ae8-bb29-bd165002e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Volume 23ce50a1-e12e-4dba-acf6-57c329bf1f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41', 'volume_size': 1} Apr 02 10:31:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5fbb78cd-09d9-4763-a11a-14f495d1ab5c tempest-GroupSnapshotsTest-1729284295 None] Group tempest-GroupSnapshotsTest-Group-1553808660: creating Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5fbb78cd-09d9-4763-a11a-14f495d1ab5c tempest-GroupSnapshotsTest-1729284295 None] Group tempest-GroupSnapshotsTest-Group-1553808660: created successfully Apr 02 10:31:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5fbb78cd-09d9-4763-a11a-14f495d1ab5c tempest-GroupSnapshotsTest-1729284295 None] Create group completed successfully. Apr 02 10:31:42 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "cinder-1d68d6d4-3823-4c09-a7bd-4617020fe6e9-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 1073741824" returned: 0 in 0.688s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-1d68d6d4-3823-4c09-a7bd-4617020fe6e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "cinder-quobyte-1f6019a0-61e0-4205-96f0-fec8e5893e97" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-quobyte-1f6019a0-61e0-4205-96f0-fec8e5893e97" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "cinder-quobyte-1d68d6d4-3823-4c09-a7bd-4617020fe6e9" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-quobyte-1d68d6d4-3823-4c09-a7bd-4617020fe6e9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Deleting offline snapshot 1d68d6d4-3823-4c09-a7bd-4617020fe6e9 of volume 1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:31:42 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 Apr 02 10:31:42 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] snapshot_file for this snap is: volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2b1ba4-244b-419f-b7e7-dfec7eab197d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:42 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 Apr 02 10:31:42 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:42 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51" returned: 0 in 0.492s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d07cc56a-c869-40a1-b84f-9362f600e7cb,created_at=2026-04-02T08:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1483153984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d07cc56a-c869-40a1-b84f-9362f600e7cb,host='devstack@QuobyteHD#QuobyteHD',id=23ce50a1-e12e-4dba-acf6-57c329bf1f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a487a50bd06463db3bc0067c45b8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:42Z,use_quota=True,user_id='1feb56af22c54e04ad64725d9f95de33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a806f8-839f-42bd-8135-8b975f8a60c9),volume_type_id=e4a806f8-839f-42bd-8135-8b975f8a60c9)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Creating volume 23ce50a1-e12e-4dba-acf6-57c329bf1f41 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:42 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ea5fdb-91dc-4baf-83e8-aaaf38ff5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1973fc-fe8a-4c05-8315-231451f00e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:42 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Volume volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 (aca647cc-63e5-4f8f-9676-59cd4cc25e51): created successfully Apr 02 10:31:42 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 1073741824 Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1973fc-fe8a-4c05-8315-231451f00e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:42 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Flow 'volume_create_manager' (f480086b-aec2-41b9-8d44-19dab7779557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:42 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2ec62b49-f47d-4c9a-a6b7-a655e5356e89 tempest-VolumesGetTest-423296423 None] Created volume successfully. Apr 02 10:31:42 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9" returned: 0 in 0.611s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6019a0-61e0-4205-96f0-fec8e5893e97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6c93e4-16ae-4889-842f-a07222ee364d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:42 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 Apr 02 10:31:42 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (46cc011e-d04d-4ced-b459-994b8c684977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f03f64-1d6e-450f-bdce-5417e37e5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f03f64-1d6e-450f-bdce-5417e37e5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965549271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46936209-1e61-43f1-8314-48a3c7459a52,host='devstack@QuobyteHD#QuobyteHD',id=5ef699b5-f872-43e2-8a34-5e2c0c1659e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:43Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8384b4e2-c429-4d86-aded-79f5bf9db65a),volume_type_id=8384b4e2-c429-4d86-aded-79f5bf9db65a)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef82337-63d3-46d5-8cbf-7add71603f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef82337-63d3-46d5-8cbf-7add71603f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4562d27-596f-416a-9f75-d9386184d636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4562d27-596f-416a-9f75-d9386184d636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef699b5-f872-43e2-8a34-5e2c0c1659e3', 'volume_name': 'volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef76ce86-27b2-44b6-8bbc-99046a2fc14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef76ce86-27b2-44b6-8bbc-99046a2fc14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553e17ad-87de-4eb1-9216-0823211a7dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:43 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Volume 5ef699b5-f872-43e2-8a34-5e2c0c1659e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3', 'volume_size': 1} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:43 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 1073741824" returned: 0 in 0.637s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:43 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 Apr 02 10:31:43 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:43 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97" returned: 0 in 0.629s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:43 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 Apr 02 10:31:43 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:43 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41" returned: 0 in 0.440s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46936209-1e61-43f1-8314-48a3c7459a52,created_at=2026-04-02T08:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1965549271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46936209-1e61-43f1-8314-48a3c7459a52,host='devstack@QuobyteHD#QuobyteHD',id=5ef699b5-f872-43e2-8a34-5e2c0c1659e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3942991bf4f84470abfeb7a67532ea9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:43Z,use_quota=True,user_id='44ee430293da474591f9b75b7ee43464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8384b4e2-c429-4d86-aded-79f5bf9db65a),volume_type_id=8384b4e2-c429-4d86-aded-79f5bf9db65a)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Creating volume 5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:43 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:43 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 1073741824 Apr 02 10:31:43 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75536c17-747c-4ae8-bb29-bd165002e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24f2fb6-5f67-40ed-9306-efc88aa99b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:43 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Volume volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 (23ce50a1-e12e-4dba-acf6-57c329bf1f41): created successfully Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24f2fb6-5f67-40ed-9306-efc88aa99b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Flow 'volume_create_manager' (8cb8c306-f348-47b0-97e3-e253c9f5da37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a5347fa7-8a61-40a3-bde6-e4a4b0348743 tempest-GroupsTest-665551612 None] Created volume successfully. Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-aca647cc-63e5-4f8f-9676-59cd4cc25e51-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Lock "cinder-aca647cc-63e5-4f8f-9676-59cd4cc25e51-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-aca647cc-63e5-4f8f-9676-59cd4cc25e51" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-aca647cc-63e5-4f8f-9676-59cd4cc25e51" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fc31a0-18bd-4c3f-99ca-5f06a6c3a588]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:44 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9" returned: 0 in 0.642s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:44 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9 Apr 02 10:31:44 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:44 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 Apr 02 10:31:44 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:44 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 1073741824" returned: 0 in 0.670s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:44 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 Apr 02 10:31:44 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:44 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97.1d68d6d4-3823-4c09-a7bd-4617020fe6e9" returned: 0 in 0.531s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-quobyte-1d68d6d4-3823-4c09-a7bd-4617020fe6e9" released by "_delete_snapshot" :: held 2.490s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-quobyte-1f6019a0-61e0-4205-96f0-fec8e5893e97" released by "delete_snapshot" :: held 2.520s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:44 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51" returned: 0 in 0.643s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:44 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51 Apr 02 10:31:44 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.quota [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Created reservations ['00ad863d-86b5-468e-ac72-2bc4d50cf66c', '5581cb1a-e6fa-4a10-abba-f63d370925e1', 'e63c7bcb-e712-43c3-b654-51f2e44b793c', '3fa68397-ad9c-4593-aa64-95308766a6e5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Delete snapshot completed successfully. Apr 02 10:31:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-3a3d48f9-eff3-4451-9c82-5c894e9b2771 req-95e29051-680d-498b-aeae-decda48bbfb4 tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-1d68d6d4-3823-4c09-a7bd-4617020fe6e9-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:45 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" returned: 0 in 0.534s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553e17ad-87de-4eb1-9216-0823211a7dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0268c84f-de1a-4d7c-b386-245fb51ca38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:45 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Volume volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 (5ef699b5-f872-43e2-8a34-5e2c0c1659e3): created successfully Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0268c84f-de1a-4d7c-b386-245fb51ca38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Flow 'volume_create_manager' (46cc011e-d04d-4ced-b459-994b8c684977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Flow 'volume_create_manager' (31617f1b-6f27-40f5-b9c6-8978a459f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373ad38c-a4f4-4731-a7d2-45630a742422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:45 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c2c513db-ff86-4390-895a-a44bf5e7ffa1 tempest-GroupSnapshotsTest-1729284295 None] Created volume successfully. Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373ad38c-a4f4-4731-a7d2-45630a742422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-541661240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d07cc56a-c869-40a1-b84f-9362f600e7cb,host='devstack@QuobyteHD#QuobyteHD',id=1c2b427a-2b90-4aea-a889-386c9d049f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a487a50bd06463db3bc0067c45b8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:45Z,use_quota=True,user_id='1feb56af22c54e04ad64725d9f95de33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a806f8-839f-42bd-8135-8b975f8a60c9),volume_type_id=e4a806f8-839f-42bd-8135-8b975f8a60c9)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4ff528-e4bd-4119-8387-c874c920a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4ff528-e4bd-4119-8387-c874c920a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d529e1-580e-445e-8e15-d51a976df965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d529e1-580e-445e-8e15-d51a976df965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2b427a-2b90-4aea-a889-386c9d049f07', 'volume_name': 'volume-1c2b427a-2b90-4aea-a889-386c9d049f07', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65b83e0-46e1-467e-8289-dd7681ab2df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:45 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65b83e0-46e1-467e-8289-dd7681ab2df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506b6517-b7a0-46cd-9c9d-4331f6ae33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:45 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Volume 1c2b427a-2b90-4aea-a889-386c9d049f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2b427a-2b90-4aea-a889-386c9d049f07', 'volume_size': 1} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d07cc56a-c869-40a1-b84f-9362f600e7cb,created_at=2026-04-02T08:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-541661240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d07cc56a-c869-40a1-b84f-9362f600e7cb,host='devstack@QuobyteHD#QuobyteHD',id=1c2b427a-2b90-4aea-a889-386c9d049f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a487a50bd06463db3bc0067c45b8497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:45Z,use_quota=True,user_id='1feb56af22c54e04ad64725d9f95de33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a806f8-839f-42bd-8135-8b975f8a60c9),volume_type_id=e4a806f8-839f-42bd-8135-8b975f8a60c9)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Creating volume 1c2b427a-2b90-4aea-a889-386c9d049f07 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:45 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-aca647cc-63e5-4f8f-9676-59cd4cc25e51" returned: 0 in 0.520s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-aca647cc-63e5-4f8f-9676-59cd4cc25e51" released by "delete_volume" :: held 1.193s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:45 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 1073741824 Apr 02 10:31:45 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Created reservations ['716e8605-b786-4a57-8092-8343c950da6f', '8a03b3c1-3c2f-4b68-9021-7a24e439579d', '852da9ac-fd05-4696-ae9f-dc67a6d458f1', 'b1368e08-1714-4ac3-bcbd-bac1c840e074'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:45 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:45 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "cinder-1f6019a0-61e0-4205-96f0-fec8e5893e97-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:45 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] GroupSnapshot 75384c39-aaac-463a-b344-5803d4b0ae76: creating. Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-1f6019a0-61e0-4205-96f0-fec8e5893e97-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Group snapshot 75384c39-aaac-463a-b344-5803d4b0ae76: creating. {{(pid=82391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "cinder-quobyte-1f6019a0-61e0-4205-96f0-fec8e5893e97" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-quobyte-1f6019a0-61e0-4205-96f0-fec8e5893e97" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36ec879-881d-43ed-b021-e109f7476349]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:45 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 Apr 02 10:31:45 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:45 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 1073741824" returned: 0 in 0.628s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:45 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 Apr 02 10:31:45 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:45 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.557s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:45 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:31:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-db0330ac-8008-4821-b771-fad6fa96861b tempest-VolumesGetTest-423296423 None] Lock "cinder-aca647cc-63e5-4f8f-9676-59cd4cc25e51-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:46 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97" returned: 0 in 0.552s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:46 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97 Apr 02 10:31:46 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:46 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:46 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-ca20a683-df3f-4b31-8b66-fafad842974c-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Lock "cinder-ca20a683-df3f-4b31-8b66-fafad842974c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Acquiring lock "cinder-quobyte-ca20a683-df3f-4b31-8b66-fafad842974c" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-ca20a683-df3f-4b31-8b66-fafad842974c" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:46 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07" returned: 0 in 0.565s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.950s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506b6517-b7a0-46cd-9c9d-4331f6ae33a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2b427a-2b90-4aea-a889-386c9d049f07', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca23773-81f4-4237-9ea5-7a310b779916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9782a597-361e-4a80-82bf-18563a8e1f3a]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Creating offline snapshot b0658eee-3b55-46f6-b688-cbf1455b89c6 of volume 5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:31:46 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Volume volume-1c2b427a-2b90-4aea-a889-386c9d049f07 (1c2b427a-2b90-4aea-a889-386c9d049f07): created successfully Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca23773-81f4-4237-9ea5-7a310b779916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Flow 'volume_create_manager' (31617f1b-6f27-40f5-b9c6-8978a459f732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f79d09-ce3d-43f1-9934-92a8bd68006c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:46 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0872adb7-2184-42c2-a23d-c3e6a0385eb4 tempest-GroupsTest-665551612 None] Created volume successfully. Apr 02 10:31:46 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:46 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:46 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 Apr 02 10:31:46 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:46 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1f6019a0-61e0-4205-96f0-fec8e5893e97" returned: 0 in 0.626s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-quobyte-1f6019a0-61e0-4205-96f0-fec8e5893e97" released by "delete_volume" :: held 1.209s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:46 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.576s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.quota [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Created reservations ['3c059c57-7526-469b-aa3c-a58d4d55a833', '87466e5a-a58b-498e-bc23-c5371964859a', '313e7718-d53d-4af1-b002-9c7155311c69', 'd9d0681e-a30d-4140-b969-e76ec8f9337e'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:46 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:46 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:47 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 0 in 0.634s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:47 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" returned: 0 in 0.660s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:47 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:47 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:47 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 1G Apr 02 10:31:47 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:47 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9f85df4b-25c3-43e0-96ab-96947b34f2df tempest-GroupsTest-665551612 None] Update group completed successfully. Apr 02 10:31:47 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.604s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG cinder.manager [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:47 devstack cinder-volume[82391]: INFO cinder.volume.manager [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Deleted volume successfully. Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [req-978689cb-3b0b-488d-8143-774e521ed828 req-2f67cef2-f702-4aec-b99d-be4880b34c7d tempest-VolumesSnapshotsTestJSON-1242004996 None] Lock "cinder-1f6019a0-61e0-4205-96f0-fec8e5893e97-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:47 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 1 in 0.727s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:47 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c Apr 02 10:31:47 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:47 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 1G" returned: 0 in 0.773s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:48 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 Apr 02 10:31:48 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:48 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca20a683-df3f-4b31-8b66-fafad842974c" returned: 0 in 0.580s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Lock "cinder-quobyte-ca20a683-df3f-4b31-8b66-fafad842974c" released by "delete_volume" :: held 1.995s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Created reservations ['9c23ba47-7451-47da-9453-bfd07998e9ee', '0889f6e2-7535-4238-8fdc-bb1a77a3188c', 'ca360443-a6d1-4d36-a8fe-f8728b870caf', '67268449-a680-4616-b27a-9ec4132cf522'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:48 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6" returned: 0 in 0.589s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:48 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:48 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 Apr 02 10:31:48 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:48 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:48 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8ec26f2f-fcde-4fed-9097-91db4325c20f tempest-GroupsTest-665551612 None] Update group completed successfully. Apr 02 10:31:49 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6" returned: 0 in 0.608s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:49 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info Apr 02 10:31:49 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:49 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.591s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:49 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Deleted volume successfully. Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8f38451a-f7ed-4edc-b226-d4ebdf332c3f tempest-VolumesGetTest-423296423 None] Lock "cinder-ca20a683-df3f-4b31-8b66-fafad842974c-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:49 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info" returned: 0 in 0.512s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:49 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:31:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:49 devstack sudo[86362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info Apr 02 10:31:49 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Acquiring lock "cinder-quobyte-1c2b427a-2b90-4aea-a889-386c9d049f07" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:50 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.info" returned: 0 in 0.609s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.848s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Lock "cinder-quobyte-1c2b427a-2b90-4aea-a889-386c9d049f07" acquired by "delete_volume" :: waited 0.033s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:50 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de305f0d-c1cc-4a95-b901-17f0a32ab923]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-03c9108a-c967-44ce-af02-cddc7759b78b tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 75384c39-aaac-463a-b344-5803d4b0ae76: created successfully Apr 02 10:31:50 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 Apr 02 10:31:50 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 75384c39-aaac-463a-b344-5803d4b0ae76: deleting Apr 02 10:31:51 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 75384c39-aaac-463a-b344-5803d4b0ae76: deleting {{(pid=82391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Flow 'volume_create_manager' (dbde4b17-2f9c-437d-b5d5-dd10861a5518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55494aea-e2a1-40c3-bb67-a1f6b8ea3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07" returned: 0 in 0.714s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55494aea-e2a1-40c3-bb67-a1f6b8ea3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-585420235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3e2373-6838-4054-b2ad-7e3d5b37d699,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72c98c820df447d8a1b56293548869d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:51Z,use_quota=True,user_id='cdfd696b5889407da7ba572bde50b794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdaa451-4432-4edd-aea4-9d6556d7bf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdaa451-4432-4edd-aea4-9d6556d7bf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d24dd0-d284-41ad-b3d0-26c8d8dc232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d24dd0-d284-41ad-b3d0-26c8d8dc232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3e2373-6838-4054-b2ad-7e3d5b37d699', 'volume_name': 'volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9ce390-0cf5-42bf-870b-ead22fac90ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9ce390-0cf5-42bf-870b-ead22fac90ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa2189d-c57f-4f8d-b661-f2e0fff7181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:51 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Volume 7d3e2373-6838-4054-b2ad-7e3d5b37d699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699', 'volume_size': 1} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-585420235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3e2373-6838-4054-b2ad-7e3d5b37d699,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72c98c820df447d8a1b56293548869d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:51Z,use_quota=True,user_id='cdfd696b5889407da7ba572bde50b794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Creating volume 7d3e2373-6838-4054-b2ad-7e3d5b37d699 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:51 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:51 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 1073741824 Apr 02 10:31:51 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:51 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07 Apr 02 10:31:51 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-b0658eee-3b55-46f6-b688-cbf1455b89c6" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-b0658eee-3b55-46f6-b688-cbf1455b89c6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Deleting offline snapshot b0658eee-3b55-46f6-b688-cbf1455b89c6 of volume 5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] snapshot_file for this snap is: volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e3cf3-67a6-4095-8b89-32829f3a3f00]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:51 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 Apr 02 10:31:51 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:51 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1c2b427a-2b90-4aea-a889-386c9d049f07" returned: 0 in 0.554s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Lock "cinder-quobyte-1c2b427a-2b90-4aea-a889-386c9d049f07" released by "delete_volume" :: held 1.355s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Acquiring lock "cinder-quobyte-23ce50a1-e12e-4dba-acf6-57c329bf1f41" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Lock "cinder-quobyte-23ce50a1-e12e-4dba-acf6-57c329bf1f41" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b287dc40-0a89-4c39-8a6d-c158f0a1d600]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:51 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 1073741824" returned: 0 in 0.652s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=233,cinder:INSERT=73,cinder:UPDATE=244,cinder:DELETE=16 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:31:51 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 Apr 02 10:31:51 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:51 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 Apr 02 10:31:51 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:51 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6" returned: 0 in 0.770s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666a735-8701-4334-bde6-9c255308ae7a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:52 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 Apr 02 10:31:52 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:52 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41" returned: 0 in 0.597s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:52 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41 Apr 02 10:31:52 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:52 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699" returned: 0 in 0.666s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa2189d-c57f-4f8d-b661-f2e0fff7181d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43e6eae-1908-42e0-b4c4-ce3580f42223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:52 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Volume volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 (7d3e2373-6838-4054-b2ad-7e3d5b37d699): created successfully Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43e6eae-1908-42e0-b4c4-ce3580f42223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Flow 'volume_create_manager' (dbde4b17-2f9c-437d-b5d5-dd10861a5518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3c723fdc-0f75-45ee-a41e-836203680a77 tempest-VolumesTestJSON-600067151 None] Created volume successfully. Apr 02 10:31:52 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" returned: 0 in 0.605s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:52 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 Apr 02 10:31:52 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:52 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-23ce50a1-e12e-4dba-acf6-57c329bf1f41" returned: 0 in 0.616s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Lock "cinder-quobyte-23ce50a1-e12e-4dba-acf6-57c329bf1f41" released by "delete_volume" :: held 1.239s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Created reservations ['efa3b271-1849-4f18-bed2-908f16b9eea6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:53 devstack cinder-volume[82391]: WARNING cinder.quota [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1822325293 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1822325293, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:53 devstack cinder-volume[82391]: WARNING cinder.quota [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1822325293 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1822325293, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Created reservations ['e8e5e91f-eb26-4d35-ae28-8241832a096d', '37f7d579-14e0-4823-9003-804dd3151633', 'b1b89ed3-37e4-4d5f-988e-59029e33c44b', '896b5663-d515-470d-8632-b8dad8ab33dc'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Created reservations ['166729f4-9bdb-4e54-86ff-29fe0ae9eac2', '62d01036-b29a-4371-bbd9-c512c156dd20', '4f9d636f-1bcd-4eab-ad99-677e7c6d3da1', '9d640e50-baab-404e-aa13-76682b89ba2f'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:53 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6" returned: 0 in 0.765s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:53 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:53 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:53 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6 Apr 02 10:31:53 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Flow 'volume_create_manager' (20eb2366-4ed6-4c8a-b293-0b0a845c3a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b49fdb-d96e-49df-b4cc-19d34072901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b49fdb-d96e-49df-b4cc-19d34072901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1840642335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14ce0f4-f80f-4937-808e-5600bf28ff61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72c98c820df447d8a1b56293548869d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:53Z,use_quota=True,user_id='cdfd696b5889407da7ba572bde50b794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85733d7f-6bb5-42ff-9d0d-458078409f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85733d7f-6bb5-42ff-9d0d-458078409f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411a54a2-7029-474b-8ff7-8d0845a70210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411a54a2-7029-474b-8ff7-8d0845a70210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14ce0f4-f80f-4937-808e-5600bf28ff61', 'volume_name': 'volume-f14ce0f4-f80f-4937-808e-5600bf28ff61', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c9fc04-60f9-4a1f-8e95-57b43c88ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c9fc04-60f9-4a1f-8e95-57b43c88ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8893499-3224-402a-8322-09d5d60eb06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:53 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Volume f14ce0f4-f80f-4937-808e-5600bf28ff61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14ce0f4-f80f-4937-808e-5600bf28ff61', 'volume_size': 1} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1840642335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14ce0f4-f80f-4937-808e-5600bf28ff61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72c98c820df447d8a1b56293548869d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:53Z,use_quota=True,user_id='cdfd696b5889407da7ba572bde50b794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Creating volume f14ce0f4-f80f-4937-808e-5600bf28ff61 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:53 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:53 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 1073741824 Apr 02 10:31:53 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:53 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.545s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:53 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8068aaa3-850e-4a2d-9829-ac02da962bdd tempest-GroupsTest-665551612 None] Delete group completed successfully. Apr 02 10:31:54 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3.b0658eee-3b55-46f6-b688-cbf1455b89c6" returned: 0 in 0.763s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-b0658eee-3b55-46f6-b688-cbf1455b89c6" released by "_delete_snapshot" :: held 2.967s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" released by "delete_snapshot" :: held 2.980s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:54 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 1073741824" returned: 0 in 0.718s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:54 devstack cinder-volume[82391]: WARNING cinder.quota [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-403241631 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-403241631, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:54 devstack cinder-volume[82391]: WARNING cinder.quota [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-403241631 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-403241631, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['58d625cb-0747-4917-9669-3375564bfee8', '998825ed-dc35-4e59-a03b-fa5a6f2a0104', '6d2f3f33-9dea-4490-a378-2c3dca89d648', '0e54956f-5207-4b7c-917b-434de2e6a924'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:54 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 Apr 02 10:31:54 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-490ef646-d387-49d2-8cdd-635b6b94ea13 tempest-GroupSnapshotsTest-1729284295 None] group_snapshot 75384c39-aaac-463a-b344-5803d4b0ae76: deleted successfully Apr 02 10:31:54 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61" returned: 0 in 0.592s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8893499-3224-402a-8322-09d5d60eb06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14ce0f4-f80f-4937-808e-5600bf28ff61', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108abbb2-0d07-4bd4-8607-005210d2677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:54 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Volume volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 (f14ce0f4-f80f-4937-808e-5600bf28ff61): created successfully Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108abbb2-0d07-4bd4-8607-005210d2677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Flow 'volume_create_manager' (20eb2366-4ed6-4c8a-b293-0b0a845c3a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-35cbde9b-169e-476e-88f7-73baa4f46ad2 tempest-VolumesTestJSON-600067151 None] Created volume successfully. Apr 02 10:31:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "cinder-quobyte-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:55 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09479e72-11b7-49c0-94c5-8d56eacffcc3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:55 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 Apr 02 10:31:55 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:55 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:31:55 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Flow 'volume_create_manager' (12cdfcdf-1ea6-4bc9-9a55-0fe6eb5eb5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c9f964-ae0b-455b-80e0-3cbee0136735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c9f964-ae0b-455b-80e0-3cbee0136735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-951441511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422d703e-1369-4c7e-977a-10a433470f4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72c98c820df447d8a1b56293548869d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:56Z,use_quota=True,user_id='cdfd696b5889407da7ba572bde50b794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f4b648-2fb7-431f-b038-310818756a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f4b648-2fb7-431f-b038-310818756a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6944715-feaa-4563-950a-3e889ed83c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6944715-feaa-4563-950a-3e889ed83c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422d703e-1369-4c7e-977a-10a433470f4a', 'volume_name': 'volume-422d703e-1369-4c7e-977a-10a433470f4a', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f060d2d-5ef2-439d-b460-1501d176462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f060d2d-5ef2-439d-b460-1501d176462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b38ac-476b-4ee2-9dd2-5e07ce34d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:56 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Volume 422d703e-1369-4c7e-977a-10a433470f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422d703e-1369-4c7e-977a-10a433470f4a', 'volume_size': 1} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-951441511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422d703e-1369-4c7e-977a-10a433470f4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72c98c820df447d8a1b56293548869d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:56Z,use_quota=True,user_id='cdfd696b5889407da7ba572bde50b794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Creating volume 422d703e-1369-4c7e-977a-10a433470f4a {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:31:56 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:56 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a 1073741824 Apr 02 10:31:56 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:56 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" returned: 0 in 0.830s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:56 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3 Apr 02 10:31:56 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:56 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a 1073741824" returned: 0 in 0.793s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:56 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a Apr 02 10:31:56 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:57 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" returned: 0 in 0.669s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Lock "cinder-quobyte-5ef699b5-f872-43e2-8a34-5e2c0c1659e3" released by "delete_volume" :: held 1.541s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['217d1eb6-0df0-466c-8fe3-3c845bea0acd'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:57 devstack cinder-volume[82391]: WARNING cinder.quota [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-403241631 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-403241631, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Created reservations ['4d053f81-09d2-427d-92c7-d40208ff13f3', 'e34a4a99-61f9-4f0a-bb0d-847b9eb8bf3f', '1572f53e-858e-49d1-a2b3-c984078c4c0e', '647afb02-874b-49db-bc54-754cb4d1709c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:57 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:31:57 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:31:57 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a" returned: 0 in 0.767s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b38ac-476b-4ee2-9dd2-5e07ce34d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422d703e-1369-4c7e-977a-10a433470f4a', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d71d571-8f2e-41fe-944b-fba6dddd6567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:31:57 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Volume volume-422d703e-1369-4c7e-977a-10a433470f4a (422d703e-1369-4c7e-977a-10a433470f4a): created successfully Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d71d571-8f2e-41fe-944b-fba6dddd6567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:31:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Flow 'volume_create_manager' (12cdfcdf-1ea6-4bc9-9a55-0fe6eb5eb5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:31:57 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-289ecc6d-2fd9-4948-b2fd-50a1b866787f tempest-VolumesTestJSON-600067151 None] Created volume successfully. Apr 02 10:31:58 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 02 10:31:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.670s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:31:58 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:31:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9148d2b2-7e59-4bae-8f1b-408eadae91bc tempest-GroupSnapshotsTest-1729284295 None] Delete group completed successfully. Apr 02 10:31:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Acquiring lock "cinder-422d703e-1369-4c7e-977a-10a433470f4a-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Lock "cinder-422d703e-1369-4c7e-977a-10a433470f4a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Acquiring lock "cinder-quobyte-422d703e-1369-4c7e-977a-10a433470f4a" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:31:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Lock "cinder-quobyte-422d703e-1369-4c7e-977a-10a433470f4a" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:31:59 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6a497f-c983-4af3-adbf-98a26f6bedb4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:31:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:31:59 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a Apr 02 10:31:59 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:00 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a" returned: 0 in 0.713s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:00 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a Apr 02 10:32:00 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Flow 'volume_create_manager' (e217dc46-ce23-4b2e-a64c-226acd74db31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cff4cc-dedc-4252-89d0-1f9cee0a7fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cff4cc-dedc-4252-89d0-1f9cee0a7fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1419494525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee76b88-c74d-4421-abf6-6e2f2d7a088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7b05c4bf9d4b0dbcf3c76ab1a24bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:00Z,use_quota=True,user_id='0e03dba2dc3f45afa2550e77349fa231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136a126a-bf73-47ba-b202-1a0a7370bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136a126a-bf73-47ba-b202-1a0a7370bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7b7f6d-ceac-47ef-8981-2d11694a33c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7b7f6d-ceac-47ef-8981-2d11694a33c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee76b88-c74d-4421-abf6-6e2f2d7a088b', 'volume_name': 'volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92472529-d451-4526-8964-f115ac9e66ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92472529-d451-4526-8964-f115ac9e66ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d35b152-3ed2-408c-99d6-12b11606129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:00 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b', 'volume_size': 1} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1419494525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee76b88-c74d-4421-abf6-6e2f2d7a088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7b05c4bf9d4b0dbcf3c76ab1a24bc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:00Z,use_quota=True,user_id='0e03dba2dc3f45afa2550e77349fa231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Creating volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:00 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:00 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b 1073741824 Apr 02 10:32:00 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:00 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-422d703e-1369-4c7e-977a-10a433470f4a" returned: 0 in 0.603s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Lock "cinder-quobyte-422d703e-1369-4c7e-977a-10a433470f4a" released by "delete_volume" :: held 1.359s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Created reservations ['bbadb902-0dc6-4b39-971b-d051e8b33b89', '05314d9c-2cd8-4470-8c50-2998b0068e08', 'f8004b95-3504-49c7-9fc2-7630c142b7e6', '9e63d25e-134e-4d03-8c21-dd0629d5b428'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:00 devstack sudo[86456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:00 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:01 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b 1073741824" returned: 0 in 0.796s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:01 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b Apr 02 10:32:01 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Acquiring lock "cinder-f14ce0f4-f80f-4937-808e-5600bf28ff61-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Lock "cinder-f14ce0f4-f80f-4937-808e-5600bf28ff61-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Acquiring lock "cinder-quobyte-f14ce0f4-f80f-4937-808e-5600bf28ff61" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Lock "cinder-quobyte-f14ce0f4-f80f-4937-808e-5600bf28ff61" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[540762d9-6a9b-4dbe-9ad8-6a2e60ba4015]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (16b89954-e0bf-472d-a28e-54a00a909c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:01 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fccbff-42ab-4cd0-8d41-04732e0b3c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.782s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fccbff-42ab-4cd0-8d41-04732e0b3c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2077004150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813d7b30-4a1d-4ee5-b312-5c3996d16dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:02Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf461ee7-99ee-47dd-9836-cb6149db023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf461ee7-99ee-47dd-9836-cb6149db023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494c8abe-efca-4991-bc7d-4670868c4f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494c8abe-efca-4991-bc7d-4670868c4f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813d7b30-4a1d-4ee5-b312-5c3996d16dd7', 'volume_name': 'volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd5776a-6a46-4e2e-996b-8f7eed443041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd5776a-6a46-4e2e-996b-8f7eed443041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0e4060-e633-4c01-a118-e10cd2ff47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume 813d7b30-4a1d-4ee5-b312-5c3996d16dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7', 'volume_size': 1} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:01 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Deleted volume successfully. Apr 02 10:32:01 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" returned: 0 in 0.587s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-64417257-4108-4478-87b4-bc830d9ee797 tempest-VolumesTestJSON-600067151 None] Lock "cinder-422d703e-1369-4c7e-977a-10a433470f4a-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2077004150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813d7b30-4a1d-4ee5-b312-5c3996d16dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:02Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Creating volume 813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:01 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:01 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 Apr 02 10:32:01 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d35b152-3ed2-408c-99d6-12b11606129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ed1e7f-079e-43d8-8f79-36337e81f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Volume volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b (6ee76b88-c74d-4421-abf6-6e2f2d7a088b): created successfully Apr 02 10:32:01 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 1073741824 Apr 02 10:32:01 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ed1e7f-079e-43d8-8f79-36337e81f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Flow 'volume_create_manager' (e217dc46-ce23-4b2e-a64c-226acd74db31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:01 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e100e085-d550-4a98-8165-efcb74111154 tempest-SnapshotsActionsTest-1664234197 None] Created volume successfully. Apr 02 10:32:02 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61" returned: 0 in 0.617s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:02 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61 Apr 02 10:32:02 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:02 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 1073741824" returned: 0 in 0.683s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:02 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 Apr 02 10:32:02 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:02 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f14ce0f4-f80f-4937-808e-5600bf28ff61" returned: 0 in 0.560s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Lock "cinder-quobyte-f14ce0f4-f80f-4937-808e-5600bf28ff61" released by "delete_volume" :: held 1.206s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Created reservations ['ed9f11e8-9c75-4910-ac11-d2daef5dc859', '1be734f8-091a-4491-8ea1-fad202a83781', '7c0c762e-6b5c-478e-8664-338d8e21a7ea', 'c7ce6298-5ce7-46e3-a8a6-cef745597444'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:02 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:02 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:02 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" returned: 0 in 0.528s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.423s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Creating offline snapshot 94e98792-dfd6-4884-ba9d-8c0e1c58232e of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0e4060-e633-4c01-a118-e10cd2ff47ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd4229-ffe0-478c-88bd-52b684ec50b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31148841-442b-4961-9ce1-2cb9c9ae89e5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 (813d7b30-4a1d-4ee5-b312-5c3996d16dd7): created successfully Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd4229-ffe0-478c-88bd-52b684ec50b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (16b89954-e0bf-472d-a28e-54a00a909c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-61f5d567-be81-438a-a1a6-1d41bff1c317 tempest-VolumesSnapshotTestJSON-1453628320 None] Created volume successfully. Apr 02 10:32:03 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b Apr 02 10:32:03 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3f1269ef-fde2-440e-9c9f-b58b604dfacb tempest-GroupSnapshotsV319Test-1351595203 None] Group tempest-GroupSnapshotsV319Test-Group-691108610: creating Apr 02 10:32:03 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.519s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Deleted volume successfully. Apr 02 10:32:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3f1269ef-fde2-440e-9c9f-b58b604dfacb tempest-GroupSnapshotsV319Test-1351595203 None] Group tempest-GroupSnapshotsV319Test-Group-691108610: created successfully Apr 02 10:32:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3f1269ef-fde2-440e-9c9f-b58b604dfacb tempest-GroupSnapshotsV319Test-1351595203 None] Create group completed successfully. Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2add29cf-c166-4b9e-a281-5b2f8682829f tempest-VolumesTestJSON-600067151 None] Lock "cinder-f14ce0f4-f80f-4937-808e-5600bf28ff61-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:03 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" returned: 0 in 0.541s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:03 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e 1G Apr 02 10:32:03 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Acquiring lock "cinder-7d3e2373-6838-4054-b2ad-7e3d5b37d699-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Lock "cinder-7d3e2373-6838-4054-b2ad-7e3d5b37d699-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Acquiring lock "cinder-quobyte-7d3e2373-6838-4054-b2ad-7e3d5b37d699" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Lock "cinder-quobyte-7d3e2373-6838-4054-b2ad-7e3d5b37d699" acquired by "delete_volume" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d9fd6-400c-47e7-a34a-991f8c7e5f9d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:03 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 Apr 02 10:32:03 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:04 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e 1G" returned: 0 in 0.592s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:04 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:04 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:04 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699" returned: 0 in 0.515s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:04 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699 Apr 02 10:32:04 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:04 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.492s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:04 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e is being set with open permissions: ugo+rw Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:04 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:04 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Flow 'volume_create_manager' (98a56639-8411-402f-9542-87b4676d02c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f71457-e0a5-45ab-a139-8d737068c8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f71457-e0a5-45ab-a139-8d737068c8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-434068355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9278ab-c417-487b-973f-1db00f166d67,host='devstack@QuobyteHD#QuobyteHD',id=225c12b6-73f4-4333-a887-d197f72fa953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00a3fb127fb64bcbacc6b865e370f681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:05Z,use_quota=True,user_id='09762d3151c944beb74c5c085d185c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8241a8e6-80fd-40a8-9b51-b38c693de7de),volume_type_id=8241a8e6-80fd-40a8-9b51-b38c693de7de)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:04 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4e183f-e2f0-4776-b568-e325521ae885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4e183f-e2f0-4776-b568-e325521ae885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1ecbe2-e4e3-4f34-93dc-fec41fda784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1ecbe2-e4e3-4f34-93dc-fec41fda784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225c12b6-73f4-4333-a887-d197f72fa953', 'volume_name': 'volume-225c12b6-73f4-4333-a887-d197f72fa953', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e10f07f-12d9-484f-9b9d-38715b20c7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e10f07f-12d9-484f-9b9d-38715b20c7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136ca13c-8ff5-4e47-8c48-1bc03cecde75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:04 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Volume 225c12b6-73f4-4333-a887-d197f72fa953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225c12b6-73f4-4333-a887-d197f72fa953', 'volume_size': 1} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7d3e2373-6838-4054-b2ad-7e3d5b37d699" returned: 0 in 0.519s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Lock "cinder-quobyte-7d3e2373-6838-4054-b2ad-7e3d5b37d699" released by "delete_volume" :: held 1.062s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Created reservations ['da1a9eca-536c-4bfa-b743-fbe8c1fe3291', 'c3ead5da-3ced-4952-a353-add72be52eaa', '13372bb4-da67-42c3-8951-065e36858b92', 'fe6cb677-60e8-431e-bf77-6ba058f27c8e'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:04 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:04 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:05 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:05 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info Apr 02 10:32:05 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:05 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.426s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:05 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Deleted volume successfully. Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-88cb05bb-bf20-44b7-b1f0-406e9ada3eb0 tempest-VolumesTestJSON-600067151 None] Lock "cinder-7d3e2373-6838-4054-b2ad-7e3d5b37d699-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:05 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info" returned: 0 in 0.417s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:05 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info is being set with open permissions: ugo+rw Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:05 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info Apr 02 10:32:05 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:05 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.info" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.014s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.101s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Creating offline snapshot c62e728a-0729-4700-99dc-19b17422f9c8 of volume 813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec42d9-22cb-4015-a2f8-b1d5239a2ccf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:05 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8fa90203-7ae3-45fb-be2a-e3c6e6ed9ae9 tempest-SnapshotsActionsTest-1664234197 None] Create snapshot completed successfully Apr 02 10:32:06 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 Apr 02 10:32:06 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:06 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" returned: 0 in 0.558s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:06 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 1G Apr 02 10:32:06 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:07 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 1G" returned: 0 in 0.663s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:07 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 Apr 02 10:32:07 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:07 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8" returned: 0 in 0.489s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:07 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 is being set with open permissions: ugo+rw Apr 02 10:32:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:07 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 Apr 02 10:32:07 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:08 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:08 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info Apr 02 10:32:08 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:08 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:08 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info is being set with open permissions: ugo+rw Apr 02 10:32:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:08 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info Apr 02 10:32:08 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:09 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.info" returned: 0 in 0.507s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.258s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa9278ab-c417-487b-973f-1db00f166d67,created_at=2026-04-02T08:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-434068355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9278ab-c417-487b-973f-1db00f166d67,host='devstack@QuobyteHD#QuobyteHD',id=225c12b6-73f4-4333-a887-d197f72fa953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00a3fb127fb64bcbacc6b865e370f681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:05Z,use_quota=True,user_id='09762d3151c944beb74c5c085d185c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8241a8e6-80fd-40a8-9b51-b38c693de7de),volume_type_id=8241a8e6-80fd-40a8-9b51-b38c693de7de)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Creating volume 225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:09 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:09 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 1073741824 Apr 02 10:32:09 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:09 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-066ab0e2-0175-448f-a96c-cb2e78e79415 tempest-VolumesSnapshotTestJSON-1453628320 None] Create snapshot completed successfully Apr 02 10:32:09 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 1073741824" returned: 0 in 0.547s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:09 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 Apr 02 10:32:09 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-c62e728a-0729-4700-99dc-19b17422f9c8-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-c62e728a-0729-4700-99dc-19b17422f9c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:10 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-c62e728a-0729-4700-99dc-19b17422f9c8" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953" returned: 0 in 0.616s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.184s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Creating offline snapshot aaf9af3c-9b81-432c-921e-63ac18a95248 of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136ca13c-8ff5-4e47-8c48-1bc03cecde75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225c12b6-73f4-4333-a887-d197f72fa953', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67aa19b-2325-4f31-901e-ea7874d20dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe469bde-641a-43d2-acb5-9f12cc36806d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-c62e728a-0729-4700-99dc-19b17422f9c8" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Deleting offline snapshot c62e728a-0729-4700-99dc-19b17422f9c8 of volume 813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] snapshot_file for this snap is: volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5472b9b-5c39-418c-a3f3-9bc8dcc9b9a0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:10 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Volume volume-225c12b6-73f4-4333-a887-d197f72fa953 (225c12b6-73f4-4333-a887-d197f72fa953): created successfully Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67aa19b-2325-4f31-901e-ea7874d20dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Flow 'volume_create_manager' (98a56639-8411-402f-9542-87b4676d02c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:10 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-86ca4d3e-5286-4baa-8bc4-209c390803b7 tempest-GroupSnapshotsV319Test-1351595203 None] Created volume successfully. Apr 02 10:32:10 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:10 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:10 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 Apr 02 10:32:10 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:11 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8" returned: 0 in 0.602s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed3d84-d938-4af0-ac00-35ddef8c9dc0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:11 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.723s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:11 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 Apr 02 10:32:11 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:11 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 1G Apr 02 10:32:11 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:11 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] GroupSnapshot 1f512cab-16e6-45fc-a793-91a827e2422b: creating. Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Group snapshot 1f512cab-16e6-45fc-a793-91a827e2422b: creating. {{(pid=82391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:11 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 1G" returned: 0 in 0.710s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:11 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" returned: 0 in 0.816s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:11 devstack sudo[86573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 Apr 02 10:32:11 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:11 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 Apr 02 10:32:11 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:12 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248" returned: 0 in 0.525s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:12 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 is being set with open permissions: ugo+rw Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:12 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 Apr 02 10:32:12 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:12 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8" returned: 0 in 0.605s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:12 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8 Apr 02 10:32:12 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:12 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248" returned: 0 in 0.467s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.358s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=247,cinder:SELECT=212,cinder:DELETE=17,cinder:INSERT=60 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Creating offline snapshot e330fb3c-359f-443c-92da-ec33dd6a8170 of volume 225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:12 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-38e8a99a-e2b5-484a-9636-629770336ff2 tempest-SnapshotsActionsTest-1664234197 None] Create snapshot completed successfully Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4036aadb-9289-4255-ab9f-b068aba134dd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:13 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 Apr 02 10:32:13 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:13 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7.c62e728a-0729-4700-99dc-19b17422f9c8" returned: 0 in 0.563s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-c62e728a-0729-4700-99dc-19b17422f9c8" released by "_delete_snapshot" :: held 2.677s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" released by "delete_snapshot" :: held 2.749s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['a4f1640c-5d99-435e-9f44-41d59fc43119', '11559a34-9f4c-46cc-9419-14f5ed28ac34', '85e8f304-7dc3-4d3c-afeb-bbbd1eeac5ac', 'acfac302-9751-4c9d-a91b-2dafd972b7e3'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Delete snapshot completed successfully. Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b84e2ac-4c48-4826-9a2b-03235f1844a0 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-c62e728a-0729-4700-99dc-19b17422f9c8-delete_snapshot" released by "delete_snapshot" :: held 2.877s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:13 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953" returned: 0 in 0.628s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-aaf9af3c-9b81-432c-921e-63ac18a95248-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-aaf9af3c-9b81-432c-921e-63ac18a95248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:13 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 1G Apr 02 10:32:13 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-aaf9af3c-9b81-432c-921e-63ac18a95248" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-aaf9af3c-9b81-432c-921e-63ac18a95248" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Deleting offline snapshot aaf9af3c-9b81-432c-921e-63ac18a95248 of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] snapshot_file for this snap is: volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f53ed-f16f-468c-9699-e34ebc5cda39]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:13 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 Apr 02 10:32:13 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (b7e501ae-08ac-427c-a6ad-8a9c8cf101dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82d8e71-c2ba-4a27-b55b-d13b90470877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82d8e71-c2ba-4a27-b55b-d13b90470877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-808612399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc122e6-1892-4b61-b874-7c8e55342474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:14Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71af37ad-194c-4535-9f02-31e8c2e03f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71af37ad-194c-4535-9f02-31e8c2e03f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cbf3e1-9eeb-4cea-a4ed-8e3a62433949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cbf3e1-9eeb-4cea-a4ed-8e3a62433949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc122e6-1892-4b61-b874-7c8e55342474', 'volume_name': 'volume-9fc122e6-1892-4b61-b874-7c8e55342474', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc37466-a312-43f0-a9fa-39e7ba30c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc37466-a312-43f0-a9fa-39e7ba30c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc67def-9512-41d2-95b6-515493f51fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume 9fc122e6-1892-4b61-b874-7c8e55342474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc122e6-1892-4b61-b874-7c8e55342474', 'volume_size': 1} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:14 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 1G" returned: 0 in 0.643s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225c12b6-73f4-4333-a887-d197f72fa953 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:14 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225c12b6-73f4-4333-a887-d197f72fa953 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 Apr 02 10:32:14 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:14 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248" returned: 0 in 0.648s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae377e8-0e04-4b07-a62a-4ff7b6ea88cc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:14 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:14 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:14 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225c12b6-73f4-4333-a887-d197f72fa953 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170" returned: 0 in 0.586s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:14 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:14 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 Apr 02 10:32:14 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:14 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.559s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:14 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 Apr 02 10:32:14 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:15 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170" returned: 0 in 0.490s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:15 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info Apr 02 10:32:15 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:15 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248" returned: 0 in 0.578s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:15 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248 Apr 02 10:32:15 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:15 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info" returned: 0 in 0.523s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:15 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info is being set with open permissions: ugo+rw: NotImplementedError Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:15 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info Apr 02 10:32:15 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:15 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.aaf9af3c-9b81-432c-921e-63ac18a95248" returned: 0 in 0.469s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-aaf9af3c-9b81-432c-921e-63ac18a95248" released by "_delete_snapshot" :: held 2.309s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" released by "delete_snapshot" :: held 2.323s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Created reservations ['fdcc476e-2d7c-4020-9e47-27865eac7903', '1174af86-a1e1-4ee4-99d6-b002b26e6467', '3eda412e-7569-4815-93ac-a4aef07c66ee', '162f0a95-5eb0-4ca0-9f79-994847e74a04'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Delete snapshot completed successfully. Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8cf7d84b-25db-4502-883c-76824787ebba tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-aaf9af3c-9b81-432c-921e-63ac18a95248-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:16 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.info" returned: 0 in 0.497s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.445s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-808612399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc122e6-1892-4b61-b874-7c8e55342474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:14Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Creating volume 9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:16 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:16 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 1073741824 Apr 02 10:32:16 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ddfce598-c81d-4152-8af8-234272fb27c4 tempest-GroupSnapshotsV319Test-1351595203 None] group_snapshot 1f512cab-16e6-45fc-a793-91a827e2422b: created successfully Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:17 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 1073741824" returned: 0 in 0.760s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:17 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:17 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] group_snapshot 1f512cab-16e6-45fc-a793-91a827e2422b: deleting Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] group_snapshot 1f512cab-16e6-45fc-a793-91a827e2422b: deleting {{(pid=82391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Flow 'volume_create_manager' (403d9b11-f20e-4167-8722-c3da806fcf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b0916c-9e47-456c-ae08-1fa07359f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b0916c-9e47-456c-ae08-1fa07359f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1150193126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f3e2f5-2b85-479f-8500-7e88d8a311a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06ab5c961ce450cbc959e1e570fe482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:17Z,use_quota=True,user_id='1d5d858e0eec458ab0c6dd3d5fd690eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed97d22e-e679-4906-a22f-e24c465b43a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed97d22e-e679-4906-a22f-e24c465b43a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e8fa71-90df-4167-99ca-253a0547c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e8fa71-90df-4167-99ca-253a0547c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f3e2f5-2b85-479f-8500-7e88d8a311a2', 'volume_name': 'volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09af69b-074b-4591-99a0-c6f0db114a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09af69b-074b-4591-99a0-c6f0db114a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b83dc7-aaad-45c7-ac19-5cb43ab9ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Volume 30f3e2f5-2b85-479f-8500-7e88d8a311a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2', 'volume_size': 1} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "cinder-quobyte-225c12b6-73f4-4333-a887-d197f72fa953" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "cinder-quobyte-225c12b6-73f4-4333-a887-d197f72fa953" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "cinder-quobyte-e330fb3c-359f-443c-92da-ec33dd6a8170" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "cinder-quobyte-e330fb3c-359f-443c-92da-ec33dd6a8170" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Deleting offline snapshot e330fb3c-359f-443c-92da-ec33dd6a8170 of volume 225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] snapshot_file for this snap is: volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[807413f0-8f33-4f33-845e-f768e97fa01d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:17 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 Apr 02 10:32:17 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:17 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.535s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.591s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Creating offline snapshot 7311831d-d203-4be6-a61a-02bca0adbbd8 of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc67def-9512-41d2-95b6-515493f51fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc122e6-1892-4b61-b874-7c8e55342474', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d835cf-d496-4f2c-b851-d809ce92d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bad4ea-6e1b-4eea-aca5-d5d1e3e2cb95]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume volume-9fc122e6-1892-4b61-b874-7c8e55342474 (9fc122e6-1892-4b61-b874-7c8e55342474): created successfully Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d835cf-d496-4f2c-b851-d809ce92d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (b7e501ae-08ac-427c-a6ad-8a9c8cf101dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-bb49b1cc-8865-4f42-985b-f1da16ee9695 tempest-VolumesSnapshotTestJSON-1453628320 None] Created volume successfully. Apr 02 10:32:17 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:17 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:18 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170" returned: 0 in 0.502s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225c12b6-73f4-4333-a887-d197f72fa953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f9f15f-e8a7-44b6-9752-c9d5e21416db]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:18 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 Apr 02 10:32:18 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:18 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.569s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:18 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 1G Apr 02 10:32:18 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:18 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953" returned: 0 in 0.607s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:18 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 Apr 02 10:32:18 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:18 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 1G" returned: 0 in 0.642s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:19 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 Apr 02 10:32:19 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:19 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170" returned: 0 in 0.531s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:19 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170 Apr 02 10:32:19 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:19 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8" returned: 0 in 0.463s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:19 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 is being set with open permissions: ugo+rw Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:19 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 Apr 02 10:32:19 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:19 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953.e330fb3c-359f-443c-92da-ec33dd6a8170" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "cinder-quobyte-e330fb3c-359f-443c-92da-ec33dd6a8170" released by "_delete_snapshot" :: held 2.142s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Lock "cinder-quobyte-225c12b6-73f4-4333-a887-d197f72fa953" released by "delete_snapshot" :: held 2.154s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:19 devstack cinder-volume[82391]: WARNING cinder.quota [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1327982921 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1327982921, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:32:19 devstack cinder-volume[82391]: WARNING cinder.quota [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1327982921 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1327982921, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] Created reservations ['edf8dea2-71bb-4c49-b72d-4dd8df7a177a', '019d549d-6608-44ca-b100-876e1d7bcac7', '0e56f85a-f4ac-4f50-a2bb-dc54b980fea6', '43090988-8595-4bdd-b45f-e23297e10e16'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e1171a0b-b3f7-4714-98b5-17e4aa7e5286 tempest-GroupSnapshotsV319Test-1351595203 None] group_snapshot 1f512cab-16e6-45fc-a793-91a827e2422b: deleted successfully Apr 02 10:32:19 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.357s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1150193126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f3e2f5-2b85-479f-8500-7e88d8a311a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06ab5c961ce450cbc959e1e570fe482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:17Z,use_quota=True,user_id='1d5d858e0eec458ab0c6dd3d5fd690eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Creating volume 30f3e2f5-2b85-479f-8500-7e88d8a311a2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:19 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:19 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 1073741824 Apr 02 10:32:19 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d13d2a6f-fa3b-4d82-8b1c-427b0a65f427 tempest-SnapshotsActionsTest-1664234197 None] Create snapshot completed successfully Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-7311831d-d203-4be6-a61a-02bca0adbbd8-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-7311831d-d203-4be6-a61a-02bca0adbbd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-7311831d-d203-4be6-a61a-02bca0adbbd8" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-7311831d-d203-4be6-a61a-02bca0adbbd8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Deleting offline snapshot 7311831d-d203-4be6-a61a-02bca0adbbd8 of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] snapshot_file for this snap is: volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[740f03e3-8571-46ce-9563-6c286bdbc1b2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:20 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 1073741824" returned: 0 in 0.544s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:20 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 Apr 02 10:32:20 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:20 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 Apr 02 10:32:20 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "cinder-quobyte-225c12b6-73f4-4333-a887-d197f72fa953" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Lock "cinder-quobyte-225c12b6-73f4-4333-a887-d197f72fa953" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc038ad-a021-40dc-82d1-cad23b6a9dca]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:20 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 Apr 02 10:32:20 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:21 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2" returned: 0 in 0.491s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.574s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:21 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b83dc7-aaad-45c7-ac19-5cb43ab9ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d023f28-74eb-41c2-8e6a-2a5a008b2f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Creating offline snapshot f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 of volume 9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8" returned: 0 in 0.577s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a841d-3987-4e15-a5b8-3d1dcd5a562e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c0a6b1-1930-4273-84f0-c8ec802f4137]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:21 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Volume volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 (30f3e2f5-2b85-479f-8500-7e88d8a311a2): created successfully Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d023f28-74eb-41c2-8e6a-2a5a008b2f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Flow 'volume_create_manager' (403d9b11-f20e-4167-8722-c3da806fcf48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a929eb66-636c-4255-a390-9481824ef265 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Created volume successfully. Apr 02 10:32:21 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:21 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:21 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:21 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:21 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953" returned: 0 in 0.575s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:21 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953 Apr 02 10:32:21 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:21 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.590s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:21 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 1G Apr 02 10:32:21 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:21 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.595s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:21 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 Apr 02 10:32:21 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "cinder-30f3e2f5-2b85-479f-8500-7e88d8a311a2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "cinder-30f3e2f5-2b85-479f-8500-7e88d8a311a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "cinder-quobyte-30f3e2f5-2b85-479f-8500-7e88d8a311a2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "cinder-quobyte-30f3e2f5-2b85-479f-8500-7e88d8a311a2" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e32d8ae-9c00-424b-85c4-2af0f6e2092b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:21 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 Apr 02 10:32:21 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:22 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-225c12b6-73f4-4333-a887-d197f72fa953" returned: 0 in 0.526s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Lock "cinder-quobyte-225c12b6-73f4-4333-a887-d197f72fa953" released by "delete_volume" :: held 1.131s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Created reservations ['c17231c7-e548-45fd-83a3-f8c24928d7a7'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:22 devstack cinder-volume[82391]: WARNING cinder.quota [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1327982921 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1327982921, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Created reservations ['d1657cac-726b-4001-887f-d6bcbcd96cd9', 'ab0690ea-1edd-40ea-b178-7702126991b9', '0538400e-469d-4d0a-84fc-8fd1faa8967a', 'b5ad4324-6d60-418a-96ac-d7578830c57d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:22 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:22 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:22 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 1G" returned: 0 in 0.600s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc122e6-1892-4b61-b874-7c8e55342474 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:22 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc122e6-1892-4b61-b874-7c8e55342474 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 Apr 02 10:32:22 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:22 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8" returned: 0 in 0.606s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:22 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8 Apr 02 10:32:22 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:22 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2" returned: 0 in 0.612s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:22 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2 Apr 02 10:32:22 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:22 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-237deb72-063b-4b43-a7d3-c1f8bce1104e tempest-GroupSnapshotsV319Test-1351595203 None] Delete group completed successfully. Apr 02 10:32:22 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc122e6-1892-4b61-b874-7c8e55342474 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" returned: 0 in 0.489s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 is being set with open permissions: ugo+rw Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:22 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 Apr 02 10:32:22 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:22 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.7311831d-d203-4be6-a61a-02bca0adbbd8" returned: 0 in 0.512s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-7311831d-d203-4be6-a61a-02bca0adbbd8" released by "_delete_snapshot" :: held 2.373s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" released by "delete_snapshot" :: held 2.392s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Created reservations ['249613ac-8365-4816-9ac1-795fffaad33e', '154bcf72-91e1-416e-88d6-51bf15eec96d', '3f74f101-8e12-4549-bea9-f1b3dc13a659', 'f2bd4172-35fd-4a0a-8b88-d7a8b412a58e'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Delete snapshot completed successfully. Apr 02 10:32:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2dcf67d3-ecda-4dd8-92f9-b27aeb5a6047 tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-7311831d-d203-4be6-a61a-02bca0adbbd8-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:23 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-30f3e2f5-2b85-479f-8500-7e88d8a311a2" returned: 0 in 0.530s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "cinder-quobyte-30f3e2f5-2b85-479f-8500-7e88d8a311a2" released by "delete_volume" :: held 1.187s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Created reservations ['0868fc64-d961-4408-bf0f-80c0cd69d572', '838c376f-5bea-453a-9f65-e67ca6aeadb7', '623500d2-c24e-4d04-ac01-53799d1ae025', '67567511-e0a7-49e5-98f0-fa1cfab3f9e8'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:23 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:23 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:23 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" returned: 0 in 0.525s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:23 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info Apr 02 10:32:23 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:23 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Deleted volume successfully. Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-030fd243-b7e5-48d8-be61-ac2ee4928392 tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "cinder-30f3e2f5-2b85-479f-8500-7e88d8a311a2-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:23 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info" returned: 0 in 0.556s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:23 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info is being set with open permissions: ugo+rw Apr 02 10:32:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:23 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info Apr 02 10:32:23 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Flow 'volume_create_manager' (03da8c21-444c-4e9f-927c-4a3c04e81638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9651fba-7734-4a19-a1b7-faa055f2867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:24 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9651fba-7734-4a19-a1b7-faa055f2867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-654662433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0132d2d-6ded-49fa-b83a-616e7ed45bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06ab5c961ce450cbc959e1e570fe482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:24Z,use_quota=True,user_id='1d5d858e0eec458ab0c6dd3d5fd690eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a982389-8c5d-41df-93a6-39832e6b17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a982389-8c5d-41df-93a6-39832e6b17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842bb463-eb73-4122-90b9-c87910683e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842bb463-eb73-4122-90b9-c87910683e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0132d2d-6ded-49fa-b83a-616e7ed45bc2', 'volume_name': 'volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef73d44f-15d6-45c0-a895-cd34cb78dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef73d44f-15d6-45c0-a895-cd34cb78dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f507d18-e289-48d6-bc26-942c8ec2092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:24 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Volume d0132d2d-6ded-49fa-b83a-616e7ed45bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2', 'volume_size': 1} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.info" returned: 0 in 0.542s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.400s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.597s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f6cf1d1c-5dc2-4013-a1cb-18fbde758cfd tempest-VolumesSnapshotTestJSON-1453628320 None] Create snapshot completed successfully Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Creating offline snapshot 378ec811-4988-4852-be11-cbc76e7e76ef of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db0c417-0c37-4b9c-b650-ea7483190b3b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:24 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:24 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:25 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.612s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (ef7bad75-566d-4827-970c-39bf43f9fba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:25 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef 1G Apr 02 10:32:25 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621662c9-05d9-4d93-a6a9-1d4b7764ae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621662c9-05d9-4d93-a6a9-1d4b7764ae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-145610090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c338fa9e-876d-4f2b-a7ef-9b372d66b0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f7a68da8-dbbf-4c0e-bcde-b70e36c6b526,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:25Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4cd915-2132-4ed8-a5c5-ee3c67a7c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4cd915-2132-4ed8-a5c5-ee3c67a7c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbb2c20-ab73-4ac5-93e6-852d78cfc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbb2c20-ab73-4ac5-93e6-852d78cfc275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c338fa9e-876d-4f2b-a7ef-9b372d66b0ae', 'volume_name': 'volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae', 'volume_size': 2, 'snapshot_id': 'f7a68da8-dbbf-4c0e-bcde-b70e36c6b526'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed902acb-37e5-4632-8de9-bce24e7d0dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed902acb-37e5-4632-8de9-bce24e7d0dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71509e6-36ad-453c-99f5-526162dc35ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:25 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Volume c338fa9e-876d-4f2b-a7ef-9b372d66b0ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae', 'volume_size': 2, 'snapshot_id': 'f7a68da8-dbbf-4c0e-bcde-b70e36c6b526'} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:25 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef 1G" returned: 0 in 0.598s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:25 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef Apr 02 10:32:25 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:26 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef" returned: 0 in 0.521s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:26 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef is being set with open permissions: ugo+rw Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:26 devstack sudo[86800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef Apr 02 10:32:26 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:26 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef" returned: 0 in 0.439s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.260s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-654662433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0132d2d-6ded-49fa-b83a-616e7ed45bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d06ab5c961ce450cbc959e1e570fe482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:24Z,use_quota=True,user_id='1d5d858e0eec458ab0c6dd3d5fd690eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Creating volume d0132d2d-6ded-49fa-b83a-616e7ed45bc2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:26 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:26 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 1073741824 Apr 02 10:32:26 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-828d0a7b-ec9e-4807-b4eb-0a83a027e8c1 tempest-SnapshotsActionsTest-1664234197 None] Create snapshot completed successfully Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-378ec811-4988-4852-be11-cbc76e7e76ef-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-378ec811-4988-4852-be11-cbc76e7e76ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-378ec811-4988-4852-be11-cbc76e7e76ef" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-378ec811-4988-4852-be11-cbc76e7e76ef" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Deleting offline snapshot 378ec811-4988-4852-be11-cbc76e7e76ef of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] snapshot_file for this snap is: volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b94b12a-cbbf-42e8-b746-1965f43a10af]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:27 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef Apr 02 10:32:27 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:27 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 1073741824" returned: 0 in 0.550s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:27 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 Apr 02 10:32:27 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:27 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef" returned: 0 in 0.606s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c104be5e-5005-4464-adba-f4c22cf6ed74]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:27 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2" returned: 0 in 0.524s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.607s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f507d18-e289-48d6-bc26-942c8ec2092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120b823c-5239-4c13-971c-a0b56a43e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Creating volume c338fa9e-876d-4f2b-a7ef-9b372d66b0ae from snapshot f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:27 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Volume volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 (d0132d2d-6ded-49fa-b83a-616e7ed45bc2): created successfully Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120b823c-5239-4c13-971c-a0b56a43e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Flow 'volume_create_manager' (03da8c21-444c-4e9f-927c-4a3c04e81638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:27 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:27 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] snapshot: f7a68da8-dbbf-4c0e-bcde-b70e36c6b526, volume: c338fa9e-876d-4f2b-a7ef-9b372d66b0ae, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:32:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7a99bfa5-f04e-48e0-8355-9724294c36ef tempest-VolumeQuotasAdminTestJSON-1448912437 None] Created volume successfully. Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e48a4b-8fde-4573-b3fc-a7f3090ad492]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:28 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 Apr 02 10:32:28 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:28 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.606s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:28 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef Apr 02 10:32:28 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:28 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" returned: 0 in 0.692s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc122e6-1892-4b61-b874-7c8e55342474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9eb61b-b3ea-4956-827d-d73f56e16abf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:28 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:28 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:28 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef" returned: 0 in 0.631s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:29 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef Apr 02 10:32:29 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:29 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a2814029-2fc0-4132-af2d-cc120243375c tempest-VolumeQuotasAdminTestJSON-1538175871 None] Transfer volume completed successfully. Apr 02 10:32:29 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.786s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:29 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae Apr 02 10:32:29 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:29 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.378ec811-4988-4852-be11-cbc76e7e76ef" returned: 0 in 0.528s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-378ec811-4988-4852-be11-cbc76e7e76ef" released by "_delete_snapshot" :: held 2.433s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" released by "delete_snapshot" :: held 2.452s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Created reservations ['0aad75cb-d3be-4e34-b0ff-ae5ac4596835', '7619d701-05b6-4f53-b99c-db7cce036c82', '71bf3b7a-a38d-4ee7-ac2a-ec5841508b54', '07c38971-f1a1-4458-873d-6bb987a125a5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:29 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Delete snapshot completed successfully. Apr 02 10:32:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84f87771-7a24-4beb-9c83-d72374ba63cd tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-378ec811-4988-4852-be11-cbc76e7e76ef-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Acquiring lock "cinder-d0132d2d-6ded-49fa-b83a-616e7ed45bc2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Lock "cinder-d0132d2d-6ded-49fa-b83a-616e7ed45bc2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Acquiring lock "cinder-quobyte-d0132d2d-6ded-49fa-b83a-616e7ed45bc2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Lock "cinder-quobyte-d0132d2d-6ded-49fa-b83a-616e7ed45bc2" acquired by "delete_volume" :: waited 0.018s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b920a5d-9af2-460a-a87a-a39a30476b53]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:31 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 Apr 02 10:32:31 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:31 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" returned: 0 in 2.404s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba67914-3789-4454-8f71-3a19b0bf2dfb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:31 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:31 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:31 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2" returned: 0 in 0.948s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:32 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2 Apr 02 10:32:32 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:32 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.601s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:32:32 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Converted 1024.00 MB image at 425.81 MB/s Apr 02 10:32:32 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae is being set with open permissions: ugo+rw Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:32 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae Apr 02 10:32:32 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:32 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d0132d2d-6ded-49fa-b83a-616e7ed45bc2" returned: 0 in 0.472s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Lock "cinder-quobyte-d0132d2d-6ded-49fa-b83a-616e7ed45bc2" released by "delete_volume" :: held 1.455s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Created reservations ['1427a273-4867-4d09-b796-e7677dc2f9b0', '9b1f7db4-ecb7-4124-9651-3d0d0fb995bd', '6c672611-3cdb-4be9-9374-43119adfb566', '61553d22-c5b2-4ccb-ad91-9c9064b94c6c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:32 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:32 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:32 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" released by "_copy_volume_from_snapshot" :: held 4.976s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" released by "_create_volume_from_snapshot" :: held 5.015s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.047s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.064s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Creating offline snapshot dfd1600c-4f2c-414e-89d8-f22c7d14ca32 of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[736581db-299d-4950-a9f8-62dafa8054dd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71509e6-36ad-453c-99f5-526162dc35ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae', 'volume_size': 2, 'snapshot_id': 'f7a68da8-dbbf-4c0e-bcde-b70e36c6b526'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7dd4f8-2f46-4338-a5ba-7352a2d83723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:32 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Volume volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae (c338fa9e-876d-4f2b-a7ef-9b372d66b0ae): created successfully Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7dd4f8-2f46-4338-a5ba-7352a2d83723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (ef7bad75-566d-4827-970c-39bf43f9fba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:32 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9940035b-7410-4ecd-b3e1-9a598948862d tempest-VolumesSnapshotTestJSON-1453628320 None] Created volume successfully. Apr 02 10:32:32 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:32 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:32 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:32 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Deleted volume successfully. Apr 02 10:32:32 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e529b818-c580-45eb-8e71-4def6d92fb09 tempest-VolumeQuotasAdminTestJSON-887559746 None] Lock "cinder-d0132d2d-6ded-49fa-b83a-616e7ed45bc2-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:33 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.501s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:33 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 1G Apr 02 10:32:33 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f110841f-a29a-427f-a79c-31f8562d5a20]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:33 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae Apr 02 10:32:33 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:34 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 1G" returned: 0 in 0.703s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:34 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 Apr 02 10:32:34 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:34 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" returned: 0 in 0.659s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:34 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae Apr 02 10:32:34 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:34 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32" returned: 0 in 0.543s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:34 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 is being set with open permissions: ugo+rw Apr 02 10:32:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:34 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 Apr 02 10:32:34 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:35 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" returned: 0 in 0.573s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae" released by "delete_volume" :: held 1.272s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['291a308c-0ba0-4283-bb4c-ea98c6fb55d7', '4551ccba-a034-410d-b7ad-da0449d9705c', '33fd8625-3712-4175-a64d-9f553f4fc769', '9a6b1b2a-1dc9-44f4-94fe-1926ba8fb895'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:35 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32" returned: 0 in 0.538s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:35 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:35 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:35 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5adb07ad-fe86-4695-bb49-cc9b60a35958 tempest-SnapshotsActionsTest-1664234197 None] Create snapshot completed successfully Apr 02 10:32:35 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.511s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:35 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Deleted volume successfully. Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4c9c3177-28f9-4fc3-8347-21dfc87bcb03 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-c338fa9e-876d-4f2b-a7ef-9b372d66b0ae-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-9fc122e6-1892-4b61-b874-7c8e55342474" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-9fc122e6-1892-4b61-b874-7c8e55342474" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Deleting offline snapshot f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 of volume 9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] snapshot_file for this snap is: volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a674e-0bf4-4c40-b687-31598447b58d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-dfd1600c-4f2c-414e-89d8-f22c7d14ca32-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-dfd1600c-4f2c-414e-89d8-f22c7d14ca32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Acquiring lock "cinder-quobyte-dfd1600c-4f2c-414e-89d8-f22c7d14ca32" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-dfd1600c-4f2c-414e-89d8-f22c7d14ca32" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Deleting offline snapshot dfd1600c-4f2c-414e-89d8-f22c7d14ca32 of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] snapshot_file for this snap is: volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4085a8ae-7da9-4bb8-bef0-e282584c1d9e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:36 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 Apr 02 10:32:36 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:36 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 Apr 02 10:32:36 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:36 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" returned: 0 in 0.579s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc122e6-1892-4b61-b874-7c8e55342474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[366db899-4b85-4144-a289-b9a08235de4d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:36 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:36 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:36 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32" returned: 0 in 0.639s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ee4818-d296-456e-8aa0-9bbd00c1f405]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:36 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:36 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:37 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.608s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:37 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 Apr 02 10:32:37 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:37 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.716s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:37 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 Apr 02 10:32:37 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:37 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" returned: 0 in 0.572s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:37 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526 Apr 02 10:32:37 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:38 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32" returned: 0 in 0.628s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:38 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32 Apr 02 10:32:38 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:38 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474.f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" returned: 0 in 0.622s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526" released by "_delete_snapshot" :: held 2.459s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-9fc122e6-1892-4b61-b874-7c8e55342474" released by "delete_snapshot" :: held 2.489s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['198d9031-3feb-407d-a51e-5f81fccdeef5', 'e6e881d1-84bd-4640-8e86-dbe2bb90a9e6', 'be6e74ab-e684-410a-82f9-0a77c70fb28e', '15428cfc-7dcb-46a7-aa98-3fb1b7da6caa'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Delete snapshot completed successfully. Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-90f78bd1-b3e0-431f-af6a-a1005180c3c5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-f7a68da8-dbbf-4c0e-bcde-b70e36c6b526-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:38 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.dfd1600c-4f2c-414e-89d8-f22c7d14ca32" returned: 0 in 0.513s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-dfd1600c-4f2c-414e-89d8-f22c7d14ca32" released by "_delete_snapshot" :: held 2.570s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" released by "delete_snapshot" :: held 2.586s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Created reservations ['02ac338c-4073-4796-bc47-bd1ce62d30b7', 'd2421073-e683-49eb-a637-2744d55f86ef', '713d23de-7071-4d06-9d7b-909f3f025c75', 'c37bc6d5-fa9b-410c-9294-f87f6a03e062'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Delete snapshot completed successfully. Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d2d5bfbd-1ee0-4ee1-895a-38c39a7df19e tempest-SnapshotsActionsTest-298181690 None] Lock "cinder-dfd1600c-4f2c-414e-89d8-f22c7d14ca32-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:38 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Flow 'volume_create_manager' (f99a5736-8e1d-4c8e-b5cf-130c0b028ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9b72c-309f-4532-b6c9-507737cf8556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9b72c-309f-4532-b6c9-507737cf8556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1128367088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12334935-7979-45d8-a961-a5d0893d4c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffccb9b50f8b46d6a94a22d60018da1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:39Z,use_quota=True,user_id='b8c81768087d40aca65578ed8f60ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f9141b-4af7-4b28-8826-1f02afa30711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f9141b-4af7-4b28-8826-1f02afa30711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf48a1a8-9e97-4203-89de-1e5e173fd6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf48a1a8-9e97-4203-89de-1e5e173fd6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12334935-7979-45d8-a961-a5d0893d4c81', 'volume_name': 'volume-12334935-7979-45d8-a961-a5d0893d4c81', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc8ac39-693e-41c9-881a-4e5b03262554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc8ac39-693e-41c9-881a-4e5b03262554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb1673a-ab79-48cb-b65d-9ab0077d6f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Volume 12334935-7979-45d8-a961-a5d0893d4c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12334935-7979-45d8-a961-a5d0893d4c81', 'volume_size': 1} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1128367088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12334935-7979-45d8-a961-a5d0893d4c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffccb9b50f8b46d6a94a22d60018da1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:39Z,use_quota=True,user_id='b8c81768087d40aca65578ed8f60ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Creating volume 12334935-7979-45d8-a961-a5d0893d4c81 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:39 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:39 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 1073741824 Apr 02 10:32:39 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-9fc122e6-1892-4b61-b874-7c8e55342474-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-9fc122e6-1892-4b61-b874-7c8e55342474-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-9fc122e6-1892-4b61-b874-7c8e55342474" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-9fc122e6-1892-4b61-b874-7c8e55342474" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cfeaf2-3605-40fe-9d46-2b95b68e8516]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:39 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:39 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Flow 'volume_create_manager' (36716a35-8ed6-4ddd-980b-499d495b7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd0f4ab-25a0-44ed-9ea4-525de036db8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd0f4ab-25a0-44ed-9ea4-525de036db8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1332247585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fff3b5-a8cd-4046-826a-c0f615b1ac1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8506265dd2d44bc7bb266bc6577ea475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:40Z,use_quota=True,user_id='3cfbb6aae59f42509db643a6d047cb27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4f73f1-9d75-444b-ae81-c29174c30a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4f73f1-9d75-444b-ae81-c29174c30a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c951f7-b95f-4cf6-9b93-484b6e31ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c951f7-b95f-4cf6-9b93-484b6e31ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fff3b5-a8cd-4046-826a-c0f615b1ac1b', 'volume_name': 'volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291082ba-ce84-457f-a041-0fd09f9e988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291082ba-ce84-457f-a041-0fd09f9e988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fbbe02-ec71-4215-84eb-a7d9f86247f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:39 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Volume 67fff3b5-a8cd-4046-826a-c0f615b1ac1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b', 'volume_size': 1} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "cinder-94e98792-dfd6-4884-ba9d-8c0e1c58232e-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:39 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-94e98792-dfd6-4884-ba9d-8c0e1c58232e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 1073741824" returned: 0 in 0.725s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "cinder-quobyte-94e98792-dfd6-4884-ba9d-8c0e1c58232e" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-quobyte-94e98792-dfd6-4884-ba9d-8c0e1c58232e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Deleting offline snapshot 94e98792-dfd6-4884-ba9d-8c0e1c58232e of volume 6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:39 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 Apr 02 10:32:39 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] snapshot_file for this snap is: volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc3ba4-6b98-4fab-8098-55d89f28ba25]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:39 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:39 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:39 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.652s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:40 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474 Apr 02 10:32:40 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:40 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81" returned: 0 in 0.481s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1332247585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fff3b5-a8cd-4046-826a-c0f615b1ac1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8506265dd2d44bc7bb266bc6577ea475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:40Z,use_quota=True,user_id='3cfbb6aae59f42509db643a6d047cb27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Creating volume 67fff3b5-a8cd-4046-826a-c0f615b1ac1b {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:40 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb1673a-ab79-48cb-b65d-9ab0077d6f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12334935-7979-45d8-a961-a5d0893d4c81', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cc21e1-015b-4f4b-914c-6e161c988999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:40 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Volume volume-12334935-7979-45d8-a961-a5d0893d4c81 (12334935-7979-45d8-a961-a5d0893d4c81): created successfully Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cc21e1-015b-4f4b-914c-6e161c988999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Flow 'volume_create_manager' (f99a5736-8e1d-4c8e-b5cf-130c0b028ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:40 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:40 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b 1073741824 Apr 02 10:32:40 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.510s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-851d02aa-0956-4d03-8270-c6927b9b05be tempest-VolumeQuotasNegativeTestJSON-388484712 None] Created volume successfully. Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94956ed9-feed-4bb1-98ae-43a4225cf4c5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:40 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b Apr 02 10:32:40 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:40 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9fc122e6-1892-4b61-b874-7c8e55342474" returned: 0 in 0.486s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-9fc122e6-1892-4b61-b874-7c8e55342474" released by "delete_volume" :: held 1.188s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['2a24531b-1b9c-4afc-b5a7-3de07b515923', 'f0fb45fb-46a4-499c-b082-44b0b5a89a1a', 'cbebf6b1-311a-4397-8a8d-650079a5c975', '2df4d61c-fd72-4f40-a2e4-41fe52e6e780'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:40 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:40 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:40 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b 1073741824" returned: 0 in 0.537s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:40 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b Apr 02 10:32:40 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:40 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" returned: 0 in 0.560s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:40 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:40 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:41 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.509s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Deleted volume successfully. Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ab779eb8-4545-4eda-a5a0-ef94c164e1c4 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-9fc122e6-1892-4b61-b874-7c8e55342474-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:41 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b" returned: 0 in 0.471s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fbbe02-ec71-4215-84eb-a7d9f86247f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b857bf4f-3fca-425b-bc4a-5d2825c29546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:41 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Volume volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b (67fff3b5-a8cd-4046-826a-c0f615b1ac1b): created successfully Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b857bf4f-3fca-425b-bc4a-5d2825c29546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Flow 'volume_create_manager' (36716a35-8ed6-4ddd-980b-499d495b7c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a617b76f-01d0-4570-a103-fd6f2e01d4e5 tempest-VolumesServicesTestJSON-41147725 None] Created volume successfully. Apr 02 10:32:41 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.568s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:41 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e Apr 02 10:32:41 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (96ec3262-b4e4-4a9e-b831-dac091289d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185750fd-9299-4cc7-a12c-7adb0be1582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185750fd-9299-4cc7-a12c-7adb0be1582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1244113451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ae0a22-8e4e-4638-b45f-3f874f360ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:42Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e367da-226c-43c3-b4d1-52729982d624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e367da-226c-43c3-b4d1-52729982d624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcb0e22-d85f-478f-a28c-a70600b58fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcb0e22-d85f-478f-a28c-a70600b58fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ae0a22-8e4e-4638-b45f-3f874f360ac4', 'volume_name': 'volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db67f01-5e87-4736-a28d-5d1a1d8e275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db67f01-5e87-4736-a28d-5d1a1d8e275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc1352d-cbd5-454a-80f4-a2fd31f74858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:41 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume e2ae0a22-8e4e-4638-b45f-3f874f360ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4', 'volume_size': 1} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1244113451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ae0a22-8e4e-4638-b45f-3f874f360ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:42Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Creating volume e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:41 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Acquiring lock "cinder-12334935-7979-45d8-a961-a5d0893d4c81-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "cinder-12334935-7979-45d8-a961-a5d0893d4c81-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:41 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 1073741824 Apr 02 10:32:41 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Acquiring lock "cinder-67fff3b5-a8cd-4046-826a-c0f615b1ac1b-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Acquiring lock "cinder-quobyte-12334935-7979-45d8-a961-a5d0893d4c81" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Lock "cinder-67fff3b5-a8cd-4046-826a-c0f615b1ac1b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "cinder-quobyte-12334935-7979-45d8-a961-a5d0893d4c81" acquired by "delete_volume" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a93aef7-2099-4589-bca3-d503449503a2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:42 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b.94e98792-dfd6-4884-ba9d-8c0e1c58232e" returned: 0 in 0.548s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Acquiring lock "cinder-quobyte-67fff3b5-a8cd-4046-826a-c0f615b1ac1b" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Lock "cinder-quobyte-67fff3b5-a8cd-4046-826a-c0f615b1ac1b" acquired by "delete_volume" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-quobyte-94e98792-dfd6-4884-ba9d-8c0e1c58232e" released by "_delete_snapshot" :: held 2.276s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52ed964-c554-4020-98c8-a9c9209d6466]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" released by "delete_snapshot" :: held 2.310s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:42 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 Apr 02 10:32:42 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Created reservations ['d1237525-7e36-41ff-b55e-613af5585f91', '960d363e-7f8a-400f-96a7-e521cdda3db1', 'a4c57729-d5fd-4ecc-898f-0d5bfe03ed5a', '17e8372b-ba05-46a7-ae34-705e7d608d5f'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:42 devstack sudo[86988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b Apr 02 10:32:42 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:42 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Delete snapshot completed successfully. Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d5e36550-9fd7-4b26-9e68-47f6a1042701 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-94e98792-dfd6-4884-ba9d-8c0e1c58232e-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:42 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 1073741824" returned: 0 in 0.675s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:42 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81" returned: 0 in 0.564s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:42 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81 Apr 02 10:32:42 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:42 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b" returned: 0 in 0.526s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:42 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:32:42 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:42 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b Apr 02 10:32:42 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "cinder-6ee76b88-c74d-4421-abf6-6e2f2d7a088b-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-6ee76b88-c74d-4421-abf6-6e2f2d7a088b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" acquired by "delete_volume" :: waited 0.018s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff57f06-f052-4a1d-be6c-1d5ab391ac39]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:43 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-12334935-7979-45d8-a961-a5d0893d4c81" returned: 0 in 0.522s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "cinder-quobyte-12334935-7979-45d8-a961-a5d0893d4c81" released by "delete_volume" :: held 1.132s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:43 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.532s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:43 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67fff3b5-a8cd-4046-826a-c0f615b1ac1b" returned: 0 in 0.532s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc1352d-cbd5-454a-80f4-a2fd31f74858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c303dfc-07c3-46a4-97ef-8f98b637e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Lock "cinder-quobyte-67fff3b5-a8cd-4046-826a-c0f615b1ac1b" released by "delete_volume" :: held 1.103s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:43 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Volume volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 (e2ae0a22-8e4e-4638-b45f-3f874f360ac4): created successfully Apr 02 10:32:43 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b Apr 02 10:32:43 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c303dfc-07c3-46a4-97ef-8f98b637e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (96ec3262-b4e4-4a9e-b831-dac091289d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-12a84755-fab7-489f-9136-428daa8e47a8 tempest-VolumesSnapshotTestJSON-1453628320 None] Created volume successfully. Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Created reservations ['e8a19353-b129-4ab5-b0ce-a57c8c80413e', '4b43b49b-49fa-4764-b3d9-55abddc920c1', 'af45977f-a0c3-40d6-8885-65e06d7d3511', '9a7f8715-bc4b-4462-8440-ed1f34f7e1ff'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Created reservations ['1d7d91f6-90c2-4ff9-8e6c-774bf86cfa4f', 'a7b32ad4-0920-44ec-b889-125ddf0f52cd', 'eb5d2aa3-e390-4d2f-af62-b2caa9835439', '3d2c6bbb-c3bf-495e-8326-97c3964f93ed'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:43 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:43 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:43 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:43 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:43 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" returned: 0 in 0.516s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:43 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b Apr 02 10:32:43 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:43 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:43 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Deleted volume successfully. Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Deleted volume successfully. Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e5b5545a-440d-42aa-b33f-9f3faf1ef800 tempest-VolumesServicesTestJSON-41147725 None] Lock "cinder-67fff3b5-a8cd-4046-826a-c0f615b1ac1b-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-85136f3a-8e46-40d0-95aa-777eab702bc8 tempest-VolumeQuotasNegativeTestJSON-388484712 None] Lock "cinder-12334935-7979-45d8-a961-a5d0893d4c81-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Creating offline snapshot 8d065f5f-9276-42c6-bbd9-4485839a11c4 of volume e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e2b0b-f7a5-4c8f-ad5e-e0a2daa4b231]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:44 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" returned: 0 in 0.503s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-quobyte-6ee76b88-c74d-4421-abf6-6e2f2d7a088b" released by "delete_volume" :: held 1.078s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:44 devstack sudo[87023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:32:44 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Created reservations ['298a28a4-071d-4b04-b2d0-01620a487f8b', '54663a10-e806-451e-a727-0321172a48f5', '3f043be0-2f87-4807-b300-b65fdb0497a1', 'db84e9b3-a393-48be-be3d-1b93156bbedc'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:44 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:44 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:44 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.673s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:44 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 1G Apr 02 10:32:44 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:44 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.620s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Deleted volume successfully. Apr 02 10:32:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aacc7877-f0b9-4922-89f0-751e14a453f8 tempest-SnapshotsActionsTest-1664234197 None] Lock "cinder-6ee76b88-c74d-4421-abf6-6e2f2d7a088b-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:45 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 1G" returned: 0 in 0.692s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:45 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 Apr 02 10:32:45 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:46 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4" returned: 0 in 0.588s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:46 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 is being set with open permissions: ugo+rw Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:46 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 Apr 02 10:32:46 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:46 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:46 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:46 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4" returned: 0 in 0.549s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:46 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info Apr 02 10:32:46 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:46 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.643s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:47 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info" returned: 0 in 0.613s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:47 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info is being set with open permissions: ugo+rw Apr 02 10:32:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:47 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info Apr 02 10:32:47 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:47 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.info" returned: 0 in 0.591s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.791s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:47 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-47f5f0ff-d723-4329-b293-a07669bf5c83 tempest-VolumesSnapshotTestJSON-1453628320 None] Create snapshot completed successfully Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (3070e73c-d655-4179-88d5-e1ad76296f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125b6f22-f660-47ab-8401-024a18954c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125b6f22-f660-47ab-8401-024a18954c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1559364574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5b340c-7faa-4054-8f49-d75547b71845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cbdba57d3443038d885fd611697c2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d065f5f-9276-42c6-bbd9-4485839a11c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:49Z,use_quota=True,user_id='df6b6bd0b5e14e9298393b47fefe80cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcfbee1-243c-4359-98c1-73136dc0e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcfbee1-243c-4359-98c1-73136dc0e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6c4bf1-220e-4a38-aab5-0f04e266530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6c4bf1-220e-4a38-aab5-0f04e266530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f5b340c-7faa-4054-8f49-d75547b71845', 'volume_name': 'volume-5f5b340c-7faa-4054-8f49-d75547b71845', 'volume_size': 1, 'snapshot_id': '8d065f5f-9276-42c6-bbd9-4485839a11c4'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c46366f-5ce3-42cd-9baf-227a3ca4a3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c46366f-5ce3-42cd-9baf-227a3ca4a3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9a71da-97f1-4b07-983d-ea639b8ae288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:48 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Volume 5f5b340c-7faa-4054-8f49-d75547b71845: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f5b340c-7faa-4054-8f49-d75547b71845', 'volume_size': 1, 'snapshot_id': '8d065f5f-9276-42c6-bbd9-4485839a11c4'} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-8d065f5f-9276-42c6-bbd9-4485839a11c4-5f5b340c-7faa-4054-8f49-d75547b71845" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-8d065f5f-9276-42c6-bbd9-4485839a11c4-5f5b340c-7faa-4054-8f49-d75547b71845" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Creating volume 5f5b340c-7faa-4054-8f49-d75547b71845 from snapshot 8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-5f5b340c-7faa-4054-8f49-d75547b71845" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-5f5b340c-7faa-4054-8f49-d75547b71845" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] snapshot: 8d065f5f-9276-42c6-bbd9-4485839a11c4, volume: 5f5b340c-7faa-4054-8f49-d75547b71845, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4231e245-c6c4-4890-bb65-74d32498c373]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:48 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 Apr 02 10:32:48 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Flow 'volume_create_manager' (7e9e3d8b-9c13-49b6-9cb3-ed165f83a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a8c68-f0ce-4523-890b-38ab176b2690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a8c68-f0ce-4523-890b-38ab176b2690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1533968649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4056d005-a73a-4b90-a6dd-b9de92991da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c2832de5a642378e9236f189d6ee67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:49Z,use_quota=True,user_id='e4d1041e957c426fb70f268d143a05d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa3dd34-1d78-4932-a920-e7205bf1d791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa3dd34-1d78-4932-a920-e7205bf1d791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4666bb4-7b2c-4bcc-8439-ae110b20d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4666bb4-7b2c-4bcc-8439-ae110b20d031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4056d005-a73a-4b90-a6dd-b9de92991da4', 'volume_name': 'volume-4056d005-a73a-4b90-a6dd-b9de92991da4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6903cb-c35d-44d1-87a8-4857ebbdf3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6903cb-c35d-44d1-87a8-4857ebbdf3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce60810a-5a8d-45c8-93a0-0493266fbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Volume 4056d005-a73a-4b90-a6dd-b9de92991da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4056d005-a73a-4b90-a6dd-b9de92991da4', 'volume_size': 1} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:49 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4" returned: 0 in 0.633s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b2399-211f-4a1c-b616-02640a50a5d5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Flow 'volume_create_manager' (47fc6f34-9926-40ea-b7bf-a85cb2b106ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:49 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:32:49 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ef50ac-ac69-4730-b658-7d9100d0169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ef50ac-ac69-4730-b658-7d9100d0169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1833904280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fae99e1-6127-45fa-89fe-a798e4c7f322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1abfa522b9c4921b93a53c418df60bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:49Z,use_quota=True,user_id='01b7fe010a204c279d481bd470a68598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff03b3ad-4abc-4d54-a16a-8a0d4ae0dfd3),volume_type_id=ff03b3ad-4abc-4d54-a16a-8a0d4ae0dfd3)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5802a0-1f32-45b6-92a2-71649d5ce245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5802a0-1f32-45b6-92a2-71649d5ce245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8099373-7791-4ef1-8400-de2e10cfe738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8099373-7791-4ef1-8400-de2e10cfe738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fae99e1-6127-45fa-89fe-a798e4c7f322', 'volume_name': 'volume-5fae99e1-6127-45fa-89fe-a798e4c7f322', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b32b5f-79a0-45ed-a845-98c22ece13ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b32b5f-79a0-45ed-a845-98c22ece13ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d59ebd-626e-40c2-8abb-858de7d9a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:49 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Volume 5fae99e1-6127-45fa-89fe-a798e4c7f322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fae99e1-6127-45fa-89fe-a798e4c7f322', 'volume_size': 1} Apr 02 10:32:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:50 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.617s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:50 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:32:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:50 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 Apr 02 10:32:50 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:52 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845" returned: 0 in 2.303s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfbbcb-684c-416f-918a-a4092199f261]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:52 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:32:52 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:53 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.693s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:32:53 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Converted 1024.00 MB image at 444.51 MB/s Apr 02 10:32:53 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 is being set with open permissions: ugo+rw Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:53 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 Apr 02 10:32:53 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=228,cinder:SELECT=198,cinder:INSERT=58,cinder:DELETE=14 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:32:53 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-5f5b340c-7faa-4054-8f49-d75547b71845" released by "_copy_volume_from_snapshot" :: held 4.740s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-8d065f5f-9276-42c6-bbd9-4485839a11c4-5f5b340c-7faa-4054-8f49-d75547b71845" released by "_create_volume_from_snapshot" :: held 4.761s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.770s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.220s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1533968649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4056d005-a73a-4b90-a6dd-b9de92991da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c2832de5a642378e9236f189d6ee67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:49Z,use_quota=True,user_id='e4d1041e957c426fb70f268d143a05d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Creating volume 4056d005-a73a-4b90-a6dd-b9de92991da4 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:53 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:53 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 1073741824 Apr 02 10:32:53 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9a71da-97f1-4b07-983d-ea639b8ae288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5b340c-7faa-4054-8f49-d75547b71845', 'volume_size': 1, 'snapshot_id': '8d065f5f-9276-42c6-bbd9-4485839a11c4'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cfd001-1d25-4003-8d3b-adc6af569813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:53 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Volume volume-5f5b340c-7faa-4054-8f49-d75547b71845 (5f5b340c-7faa-4054-8f49-d75547b71845): created successfully Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cfd001-1d25-4003-8d3b-adc6af569813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Flow 'volume_create_manager' (3070e73c-d655-4179-88d5-e1ad76296f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d1fe4dc2-7f01-4dda-bc6d-f475b88c890f tempest-VolumesSnapshotTestJSON-1453628320 None] Created volume successfully. Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 1073741824" returned: 0 in 0.632s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:54 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-5f5b340c-7faa-4054-8f49-d75547b71845-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-5f5b340c-7faa-4054-8f49-d75547b71845-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:54 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 Apr 02 10:32:54 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-5f5b340c-7faa-4054-8f49-d75547b71845" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-5f5b340c-7faa-4054-8f49-d75547b71845" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f9ab3-166d-4062-a8d7-7464613c106f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:54 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 Apr 02 10:32:54 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:54 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4" returned: 0 in 0.603s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.233s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1833904280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fae99e1-6127-45fa-89fe-a798e4c7f322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1abfa522b9c4921b93a53c418df60bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:49Z,use_quota=True,user_id='01b7fe010a204c279d481bd470a68598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff03b3ad-4abc-4d54-a16a-8a0d4ae0dfd3),volume_type_id=ff03b3ad-4abc-4d54-a16a-8a0d4ae0dfd3)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Creating volume 5fae99e1-6127-45fa-89fe-a798e4c7f322 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:54 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce60810a-5a8d-45c8-93a0-0493266fbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4056d005-a73a-4b90-a6dd-b9de92991da4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:54 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 1073741824 Apr 02 10:32:54 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2341741e-770a-4277-a615-ee7011738c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:54 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Volume volume-4056d005-a73a-4b90-a6dd-b9de92991da4 (4056d005-a73a-4b90-a6dd-b9de92991da4): created successfully Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2341741e-770a-4277-a615-ee7011738c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Flow 'volume_create_manager' (7e9e3d8b-9c13-49b6-9cb3-ed165f83a186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2b13fa42-30d7-41fe-ac10-afc690c897d7 tempest-VolumesListAdminTestJSON-1374935626 None] Created volume successfully. Apr 02 10:32:54 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845" returned: 0 in 0.693s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:54 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845 Apr 02 10:32:54 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:55 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 1073741824" returned: 0 in 0.682s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:55 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5f5b340c-7faa-4054-8f49-d75547b71845" returned: 0 in 0.590s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:55 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 Apr 02 10:32:55 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-5f5b340c-7faa-4054-8f49-d75547b71845" released by "delete_volume" :: held 1.337s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['fe39ae50-3522-4814-bd1d-8f83cf54aff1', 'd7d0ed31-c2d8-4d3d-8248-d9988f86c889', '0b49542c-6e46-4f40-84b0-7844e508474b', '8b0d8b4f-3070-4f4b-b53a-150e314e0ab1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:55 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:55 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Flow 'volume_create_manager' (f8c6616a-4b89-45ca-b514-8575f84c3c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf49367-b49e-4ce8-95b4-0b0830eac263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf49367-b49e-4ce8-95b4-0b0830eac263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1313871143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2356e83a-a693-47fa-86ba-90737e3c3af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c2832de5a642378e9236f189d6ee67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:56Z,use_quota=True,user_id='e4d1041e957c426fb70f268d143a05d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644cb02a-2540-466f-8840-58ea163cd691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644cb02a-2540-466f-8840-58ea163cd691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5eef328-e42b-4e0f-8ed6-3b677bb31af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5eef328-e42b-4e0f-8ed6-3b677bb31af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2356e83a-a693-47fa-86ba-90737e3c3af5', 'volume_name': 'volume-2356e83a-a693-47fa-86ba-90737e3c3af5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2e2e6a-954d-449f-9e9a-959e4d2c9f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2e2e6a-954d-449f-9e9a-959e4d2c9f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83233e20-57cf-4774-a5e1-1d74134fcbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:56 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Volume 2356e83a-a693-47fa-86ba-90737e3c3af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2356e83a-a693-47fa-86ba-90737e3c3af5', 'volume_size': 1} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:56 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322" returned: 0 in 0.697s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1313871143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2356e83a-a693-47fa-86ba-90737e3c3af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c2832de5a642378e9236f189d6ee67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:56Z,use_quota=True,user_id='e4d1041e957c426fb70f268d143a05d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Creating volume 2356e83a-a693-47fa-86ba-90737e3c3af5 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:56 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:56 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 1073741824 Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d59ebd-626e-40c2-8abb-858de7d9a42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fae99e1-6127-45fa-89fe-a798e4c7f322', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:56 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613c593f-4262-4923-9757-5635a80eea76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:56 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Volume volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 (5fae99e1-6127-45fa-89fe-a798e4c7f322): created successfully Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613c593f-4262-4923-9757-5635a80eea76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Flow 'volume_create_manager' (47fc6f34-9926-40ea-b7bf-a85cb2b106ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c04665a7-bddd-4e03-9b01-85fcdb3ac9f2 tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Created volume successfully. Apr 02 10:32:56 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.614s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Deleted volume successfully. Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65d51d7b-c0dd-4dc7-9037-786c811c3626 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-5f5b340c-7faa-4054-8f49-d75547b71845-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-8d065f5f-9276-42c6-bbd9-4485839a11c4-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-8d065f5f-9276-42c6-bbd9-4485839a11c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-8d065f5f-9276-42c6-bbd9-4485839a11c4" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-8d065f5f-9276-42c6-bbd9-4485839a11c4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Deleting offline snapshot 8d065f5f-9276-42c6-bbd9-4485839a11c4 of volume e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] snapshot_file for this snap is: volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca9a319-ccaf-4f80-8249-6423263cbb91]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:56 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 Apr 02 10:32:56 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:56 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 1073741824" returned: 0 in 0.650s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:56 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 Apr 02 10:32:56 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:57 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4" returned: 0 in 0.692s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce452e94-2b43-45e1-83ae-5277ca3af50f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:57 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:32:57 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:57 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:32:57 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:57 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5" returned: 0 in 0.658s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83233e20-57cf-4774-a5e1-1d74134fcbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2356e83a-a693-47fa-86ba-90737e3c3af5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11347b07-1aa0-4d9c-86c1-20737a919719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:57 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Volume volume-2356e83a-a693-47fa-86ba-90737e3c3af5 (2356e83a-a693-47fa-86ba-90737e3c3af5): created successfully Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11347b07-1aa0-4d9c-86c1-20737a919719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Flow 'volume_create_manager' (f8c6616a-4b89-45ca-b514-8575f84c3c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:57 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7cc30004-8bfb-49d5-a308-9f0fe784876b tempest-VolumesListAdminTestJSON-1374935626 None] Created volume successfully. Apr 02 10:32:57 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.537s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:57 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 Apr 02 10:32:57 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:57 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.586s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:57 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:32:57 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e94d2a91-909e-4078-8582-ac27d7f79c9e tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Retype volume completed successfully. Apr 02 10:32:58 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4" returned: 0 in 0.658s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:58 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4 Apr 02 10:32:58 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Acquiring lock "cinder-5fae99e1-6127-45fa-89fe-a798e4c7f322-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "cinder-5fae99e1-6127-45fa-89fe-a798e4c7f322-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Acquiring lock "cinder-quobyte-5fae99e1-6127-45fa-89fe-a798e4c7f322" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "cinder-quobyte-5fae99e1-6127-45fa-89fe-a798e4c7f322" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8c6ac-02a4-48d5-b3f5-3f9a53dd9fc1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Flow 'volume_create_manager' (ca5961a1-a94a-4bfa-ad6c-36ccf65ef440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b286ca5-ed87-4879-9e53-5e980899e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b286ca5-ed87-4879-9e53-5e980899e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1446439229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5a74a5-6551-4f03-a55e-cff25560423d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c2832de5a642378e9236f189d6ee67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:59Z,use_quota=True,user_id='e4d1041e957c426fb70f268d143a05d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047d3984-9d5a-48f4-8f94-d51294bebab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047d3984-9d5a-48f4-8f94-d51294bebab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:58 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 Apr 02 10:32:58 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3d0589-dc8c-4fdb-bfcd-2c6fcc8f0f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3d0589-dc8c-4fdb-bfcd-2c6fcc8f0f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5a74a5-6551-4f03-a55e-cff25560423d', 'volume_name': 'volume-9c5a74a5-6551-4f03-a55e-cff25560423d', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe23555-4b61-4308-9a41-aea6616d1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe23555-4b61-4308-9a41-aea6616d1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63446f1-915e-48d4-85e7-6363e4dae900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:32:58 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Volume 9c5a74a5-6551-4f03-a55e-cff25560423d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5a74a5-6551-4f03-a55e-cff25560423d', 'volume_size': 1} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1446439229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5a74a5-6551-4f03-a55e-cff25560423d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c2832de5a642378e9236f189d6ee67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:59Z,use_quota=True,user_id='e4d1041e957c426fb70f268d143a05d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Creating volume 9c5a74a5-6551-4f03-a55e-cff25560423d {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:32:58 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:32:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:58 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d 1073741824 Apr 02 10:32:58 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:59 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4.8d065f5f-9276-42c6-bbd9-4485839a11c4" returned: 0 in 0.563s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-8d065f5f-9276-42c6-bbd9-4485839a11c4" released by "_delete_snapshot" :: held 2.529s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" released by "delete_snapshot" :: held 2.544s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['693c6d9d-66d2-423d-a648-873cc3ff40e1', 'a5899e12-4f20-4d1b-aad7-ee8da0997b03', 'b50882d3-51c0-4b56-b827-6f24c6b81c5c', '02dccca1-b001-4324-b884-a8055942e754'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:32:59 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Delete snapshot completed successfully. Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-122e1b9d-a034-42c2-b5ad-05c4605c1bb5 tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-8d065f5f-9276-42c6-bbd9-4485839a11c4-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:32:59 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322" returned: 0 in 0.679s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:59 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322 Apr 02 10:32:59 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:59 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d 1073741824" returned: 0 in 0.655s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:32:59 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d Apr 02 10:32:59 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-e2ae0a22-8e4e-4638-b45f-3f874f360ac4-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-e2ae0a22-8e4e-4638-b45f-3f874f360ac4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86f6fce-2fec-46f7-a86f-b1646b2bb34f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:32:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:00 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:33:00 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:00 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5fae99e1-6127-45fa-89fe-a798e4c7f322" returned: 0 in 0.626s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "cinder-quobyte-5fae99e1-6127-45fa-89fe-a798e4c7f322" released by "delete_volume" :: held 1.341s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:00 devstack cinder-volume[82391]: WARNING cinder.quota [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:33:00 devstack cinder-volume[82391]: WARNING cinder.quota [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Created reservations ['c0af1657-7d0c-4068-b98b-933901c8a9e9', 'e5ea425b-7769-4462-add1-e4998dbc7c76', 'e80918fa-45c3-46ff-8a5c-1430b562f01a', 'd9ebb521-8da3-48f8-bc00-645119703c21'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:00 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d" returned: 0 in 0.575s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63446f1-915e-48d4-85e7-6363e4dae900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5a74a5-6551-4f03-a55e-cff25560423d', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364ea60b-af48-454d-b676-c408bff3f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:00 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Volume volume-9c5a74a5-6551-4f03-a55e-cff25560423d (9c5a74a5-6551-4f03-a55e-cff25560423d): created successfully Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364ea60b-af48-454d-b676-c408bff3f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Flow 'volume_create_manager' (ca5961a1-a94a-4bfa-ad6c-36ccf65ef440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f033c2a3-ac18-4196-88c6-670ff22473c7 tempest-VolumesListAdminTestJSON-1374935626 None] Created volume successfully. Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:00 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:00 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:00 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.609s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:00 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4 Apr 02 10:33:00 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:00 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.505s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Deleted volume successfully. Apr 02 10:33:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8977f418-c282-4b12-9f61-2e13bdb9c21f tempest-VolumeRetypeWithoutMigrationTest-1074303536 None] Lock "cinder-5fae99e1-6127-45fa-89fe-a798e4c7f322-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:01 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" returned: 0 in 0.532s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-e2ae0a22-8e4e-4638-b45f-3f874f360ac4" released by "delete_volume" :: held 1.201s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['6af89768-3476-4b30-b228-75d5a41e9aa1', '28220359-7201-40a7-bfce-a1f5cdf5d992', 'f38e35ad-567d-4e60-ac3d-b861324bb6ed', 'a1873e4a-9e8f-4249-81bd-b71debfb11e2'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:01 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:01 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Flow 'volume_create_manager' (41ba296c-9a50-4394-b351-af30ffca105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24aa6a78-cd09-440e-9221-4ccf621c524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24aa6a78-cd09-440e-9221-4ccf621c524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e892a04-912a-4462-913b-978b4dddb7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d338f5c53014ded8c564b613d25494b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:02Z,use_quota=True,user_id='f3144ba5b1e54dd0a80854037206c97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685b7dda-a229-49f6-bf84-adbbe99e56ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685b7dda-a229-49f6-bf84-adbbe99e56ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cceae6a1-28cd-46b3-898e-c3f1bf00ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cceae6a1-28cd-46b3-898e-c3f1bf00ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e892a04-912a-4462-913b-978b4dddb7d1', 'volume_name': 'volume-9e892a04-912a-4462-913b-978b4dddb7d1', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b379fcf2-804a-41fa-bf41-2a6d176f41d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b379fcf2-804a-41fa-bf41-2a6d176f41d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14ce744-f6e5-4c17-993c-573690d1d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Volume 9e892a04-912a-4462-913b-978b4dddb7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e892a04-912a-4462-913b-978b4dddb7d1', 'volume_size': 1} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e892a04-912a-4462-913b-978b4dddb7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d338f5c53014ded8c564b613d25494b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:02Z,use_quota=True,user_id='f3144ba5b1e54dd0a80854037206c97a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Creating volume 9e892a04-912a-4462-913b-978b4dddb7d1 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:01 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:01 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 1073741824 Apr 02 10:33:01 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:01 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.512s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:01 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Deleted volume successfully. Apr 02 10:33:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8ed57370-a418-4251-9f6d-8eca9f5caa1c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-e2ae0a22-8e4e-4638-b45f-3f874f360ac4-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-813d7b30-4a1d-4ee5-b312-5c3996d16dd7-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-813d7b30-4a1d-4ee5-b312-5c3996d16dd7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "cinder-quobyte-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" acquired by "delete_volume" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e318867b-ec5e-4d90-b07d-4e2a63edee52]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:02 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 Apr 02 10:33:02 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:02 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 1073741824" returned: 0 in 0.751s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:02 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 Apr 02 10:33:02 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:02 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" returned: 0 in 0.706s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:03 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1" returned: 0 in 0.509s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:03 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7 Apr 02 10:33:03 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14ce744-f6e5-4c17-993c-573690d1d171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e892a04-912a-4462-913b-978b4dddb7d1', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb77541-0ade-43e7-8712-40292e8f634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:03 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Volume volume-9e892a04-912a-4462-913b-978b4dddb7d1 (9e892a04-912a-4462-913b-978b4dddb7d1): created successfully Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb77541-0ade-43e7-8712-40292e8f634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Flow 'volume_create_manager' (41ba296c-9a50-4394-b351-af30ffca105e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-bc43c008-add1-4778-8e19-e67e520c0065 tempest-VolumesListAdminTestJSON-2000344581 None] Created volume successfully. Apr 02 10:33:03 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" returned: 0 in 0.668s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-quobyte-813d7b30-4a1d-4ee5-b312-5c3996d16dd7" released by "delete_volume" :: held 1.413s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Created reservations ['b3688e88-2a95-482a-a2d5-6bbcafa774fc', 'a60d3a46-977c-47aa-89fa-705b3382e875', 'a607ab9e-486c-4ef4-a113-5245913602fb', '24129a34-daaa-4aba-9b0f-6c97dbe88a7a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:03 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:03 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Acquiring lock "cinder-9e892a04-912a-4462-913b-978b4dddb7d1-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "cinder-9e892a04-912a-4462-913b-978b4dddb7d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Acquiring lock "cinder-quobyte-9e892a04-912a-4462-913b-978b4dddb7d1" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "cinder-quobyte-9e892a04-912a-4462-913b-978b4dddb7d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce4571b-3380-4cae-925f-6a2b3142efb8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "cinder-9c5a74a5-6551-4f03-a55e-cff25560423d-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-9c5a74a5-6551-4f03-a55e-cff25560423d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:04 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 Apr 02 10:33:04 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "cinder-quobyte-9c5a74a5-6551-4f03-a55e-cff25560423d" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-quobyte-9c5a74a5-6551-4f03-a55e-cff25560423d" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ac826-4072-414f-b778-9dae241bf6be]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:04 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d Apr 02 10:33:04 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:04 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.777s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:04 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Deleted volume successfully. Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-43f20819-e7c9-466f-bee5-61dd130d2a4c tempest-VolumesSnapshotTestJSON-1453628320 None] Lock "cinder-813d7b30-4a1d-4ee5-b312-5c3996d16dd7-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:04 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1" returned: 0 in 0.858s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:04 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1 Apr 02 10:33:04 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:05 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d" returned: 0 in 0.739s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:05 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d Apr 02 10:33:05 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:05 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9e892a04-912a-4462-913b-978b4dddb7d1" returned: 0 in 0.496s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "cinder-quobyte-9e892a04-912a-4462-913b-978b4dddb7d1" released by "delete_volume" :: held 1.398s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Created reservations ['f5df0a83-50fe-4692-9327-fa6d86266bed', '68f41b1d-7da9-43ac-9e72-0a81180f842b', '28d8c473-196d-49f9-b6a6-f28e16e5a809', '2a2019d1-646f-4642-b4bf-ec7e8b3a618d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:05 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:05 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Flow 'volume_create_manager' (c6258b4f-22a5-4425-ae6d-c03f1f009bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314eaabc-63b4-4434-84c7-836b93dab161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314eaabc-63b4-4434-84c7-836b93dab161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-549181929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4771b74f-987d-41b0-a35f-358ab41198b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7e7b817f454e65b302777aa3fb108b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:06Z,use_quota=True,user_id='cd48d0a2474a46ea841d39765f1a0d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2805d80a-750a-42df-bd8a-70748e16805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2805d80a-750a-42df-bd8a-70748e16805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b18b117-1a10-4249-b2cd-7d760eee73a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b18b117-1a10-4249-b2cd-7d760eee73a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4771b74f-987d-41b0-a35f-358ab41198b2', 'volume_name': 'volume-4771b74f-987d-41b0-a35f-358ab41198b2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed91122a-5f87-4f65-aab7-5528103a2d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed91122a-5f87-4f65-aab7-5528103a2d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b215f016-191b-4a87-9484-bcbf363bb665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:05 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Volume 4771b74f-987d-41b0-a35f-358ab41198b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4771b74f-987d-41b0-a35f-358ab41198b2', 'volume_size': 1} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-549181929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4771b74f-987d-41b0-a35f-358ab41198b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7e7b817f454e65b302777aa3fb108b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:06Z,use_quota=True,user_id='cd48d0a2474a46ea841d39765f1a0d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Creating volume 4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:05 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:05 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 1073741824 Apr 02 10:33:05 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:05 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9c5a74a5-6551-4f03-a55e-cff25560423d" returned: 0 in 0.759s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-quobyte-9c5a74a5-6551-4f03-a55e-cff25560423d" released by "delete_volume" :: held 1.550s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Created reservations ['27fd5ba3-79aa-4dac-8276-8e32cfef9797', '8c40fcea-ec83-4892-b5b0-786238c0d353', 'fe1641aa-20fc-4fd5-9941-d196df8b7062', 'c25ffe2f-0a3a-4211-b89f-3a09b563eefd'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:05 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:05 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:06 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.748s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Deleted volume successfully. Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbac460-49fc-4eb8-a266-d27cb4f51f82 tempest-VolumesListAdminTestJSON-2000344581 None] Lock "cinder-9e892a04-912a-4462-913b-978b4dddb7d1-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:06 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Deleted volume successfully. Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-70acab8f-3c5e-4c2e-9042-5b9970e37bc8 tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-9c5a74a5-6551-4f03-a55e-cff25560423d-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:06 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 1073741824" returned: 0 in 0.835s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:06 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 Apr 02 10:33:06 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "cinder-2356e83a-a693-47fa-86ba-90737e3c3af5-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-2356e83a-a693-47fa-86ba-90737e3c3af5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "cinder-quobyte-2356e83a-a693-47fa-86ba-90737e3c3af5" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-quobyte-2356e83a-a693-47fa-86ba-90737e3c3af5" acquired by "delete_volume" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd1d236-8e01-47c7-9822-9b4c954b9c7e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:06 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 Apr 02 10:33:06 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:07 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2" returned: 0 in 0.608s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b215f016-191b-4a87-9484-bcbf363bb665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4771b74f-987d-41b0-a35f-358ab41198b2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c77e15c-00dd-4d8f-9009-90896276bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:07 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Volume volume-4771b74f-987d-41b0-a35f-358ab41198b2 (4771b74f-987d-41b0-a35f-358ab41198b2): created successfully Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c77e15c-00dd-4d8f-9009-90896276bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Flow 'volume_create_manager' (c6258b4f-22a5-4425-ae6d-c03f1f009bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:07 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0c7c62fa-c627-4146-9b26-252077237ed6 tempest-SnapshotMetadataTestJSON-816803835 None] Created volume successfully. Apr 02 10:33:07 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5" returned: 0 in 0.607s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:07 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5 Apr 02 10:33:07 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:07 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2356e83a-a693-47fa-86ba-90737e3c3af5" returned: 0 in 0.467s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-quobyte-2356e83a-a693-47fa-86ba-90737e3c3af5" released by "delete_volume" :: held 1.107s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:07 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Created reservations ['c93eb875-1f96-4821-a03c-3e0d9d1cc9e9', '3c0702d0-3d93-46bd-a9c6-b86fdfaba9f4', '1a0cc54b-7ec9-419a-96b9-785f667fd99e', 'bdf58b3e-4ae0-4c6d-b4bf-683fb39977cf'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Creating offline snapshot 57cc2cb5-39b1-4b73-aa25-5c96cb063d9d of volume 4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81472794-7213-438e-a68f-65ab03137571]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:08 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:08 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:08 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 Apr 02 10:33:08 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:08 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2" returned: 0 in 0.726s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:08 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d 1G Apr 02 10:33:08 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:08 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.794s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:08 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Deleted volume successfully. Apr 02 10:33:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3740eeef-d579-4c64-a630-841e51e0e46d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-2356e83a-a693-47fa-86ba-90737e3c3af5-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "cinder-4056d005-a73a-4b90-a6dd-b9de92991da4-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-4056d005-a73a-4b90-a6dd-b9de92991da4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "cinder-quobyte-4056d005-a73a-4b90-a6dd-b9de92991da4" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-quobyte-4056d005-a73a-4b90-a6dd-b9de92991da4" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[566d9851-8776-4c8b-8d27-27d3cd667886]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:09 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 Apr 02 10:33:09 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:09 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d 1G" returned: 0 in 0.753s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4771b74f-987d-41b0-a35f-358ab41198b2 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:09 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4771b74f-987d-41b0-a35f-358ab41198b2 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d Apr 02 10:33:09 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:09 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4" returned: 0 in 0.551s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:09 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4 Apr 02 10:33:09 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:10 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4771b74f-987d-41b0-a35f-358ab41198b2 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" returned: 0 in 0.584s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:10 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d is being set with open permissions: ugo+rw Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:10 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d Apr 02 10:33:10 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:10 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4056d005-a73a-4b90-a6dd-b9de92991da4" returned: 0 in 0.652s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-quobyte-4056d005-a73a-4b90-a6dd-b9de92991da4" released by "delete_volume" :: held 1.231s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Created reservations ['94400e40-98ab-4b9f-be78-71768ae8a976', 'ffc4caec-b3ce-43f1-b18b-2b725fe8c428', '6d986a5a-ffd1-454d-99c8-59fca42a0f37', '139f3ce9-29ca-499d-b134-51565c90b470'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (1c3b6a35-4b53-486e-a23f-60c1ef282dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7913db05-7fd2-4509-afbe-b3602d8f22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7913db05-7fd2-4509-afbe-b3602d8f22f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1971178427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d886d5d-d3e2-47a7-b29c-55bcfc8707a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d5a58fd3024c79a5a18aebc95f07e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:11Z,use_quota=True,user_id='db04e3de4ca04274adbec010f2cacda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78fc5b1-be7d-4801-b7c3-8591d1ba5d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:10 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78fc5b1-be7d-4801-b7c3-8591d1ba5d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:10 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a17f0d-2959-4f8b-8647-a356de1a06b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a17f0d-2959-4f8b-8647-a356de1a06b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d886d5d-d3e2-47a7-b29c-55bcfc8707a5', 'volume_name': 'volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96f5f9d-95a0-427e-b66b-fad86020c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96f5f9d-95a0-427e-b66b-fad86020c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc315e10-a174-4a76-b017-a89bed5b26d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:10 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Volume 5d886d5d-d3e2-47a7-b29c-55bcfc8707a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5', 'volume_size': 1} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:10 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" returned: 0 in 0.595s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:10 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info Apr 02 10:33:10 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:11 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.525s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:11 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Deleted volume successfully. Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3ba088a2-c3be-412b-85dd-0b29ff17749d tempest-VolumesListAdminTestJSON-1374935626 None] Lock "cinder-4056d005-a73a-4b90-a6dd-b9de92991da4-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:11 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info" returned: 0 in 0.538s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:11 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info is being set with open permissions: ugo+rw Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:11 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info Apr 02 10:33:11 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:11 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.info" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.730s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1971178427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d886d5d-d3e2-47a7-b29c-55bcfc8707a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d5a58fd3024c79a5a18aebc95f07e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:11Z,use_quota=True,user_id='db04e3de4ca04274adbec010f2cacda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Creating volume 5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:11 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:11 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-de2a5add-4d14-4ff1-b339-723aa2b4add7 tempest-SnapshotMetadataTestJSON-816803835 None] Create snapshot completed successfully Apr 02 10:33:11 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 1073741824 Apr 02 10:33:11 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:12 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 1073741824" returned: 0 in 0.739s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:12 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:12 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "cinder-57cc2cb5-39b1-4b73-aa25-5c96cb063d9d-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-57cc2cb5-39b1-4b73-aa25-5c96cb063d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "cinder-quobyte-4771b74f-987d-41b0-a35f-358ab41198b2" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-quobyte-4771b74f-987d-41b0-a35f-358ab41198b2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "cinder-quobyte-57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-quobyte-57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Deleting offline snapshot 57cc2cb5-39b1-4b73-aa25-5c96cb063d9d of volume 4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] snapshot_file for this snap is: volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec06191-a120-4369-8759-ed5f74e18b15]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:13 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d Apr 02 10:33:13 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:13 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.655s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc315e10-a174-4a76-b017-a89bed5b26d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f455182a-d695-4b8c-8af9-7efd12fb9865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Volume volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 (5d886d5d-d3e2-47a7-b29c-55bcfc8707a5): created successfully Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f455182a-d695-4b8c-8af9-7efd12fb9865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (1c3b6a35-4b53-486e-a23f-60c1ef282dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ec8b3510-4fc5-42c6-88e9-55c5f62e224a tempest-VolumeDependencyTests-1403225744 None] Created volume successfully. Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=203,cinder:INSERT=51,cinder:UPDATE=248,cinder:DELETE=20 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:33:13 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" returned: 0 in 0.755s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4771b74f-987d-41b0-a35f-358ab41198b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2724dc1a-31c9-42e4-8b56-4418e85dbef4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Creating offline snapshot 125f659f-f787-4c54-8841-f4a1eafbbe58 of volume 5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0580f728-e5d7-4e87-99b0-682228591e9c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:13 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 Apr 02 10:33:13 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:14 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:14 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:14 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2" returned: 0 in 0.563s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:14 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d Apr 02 10:33:14 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:14 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.658s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:14 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 1G Apr 02 10:33:14 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:15 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" returned: 0 in 0.820s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:15 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d Apr 02 10:33:15 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:15 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 1G" returned: 0 in 0.707s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:15 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 Apr 02 10:33:15 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Flow 'volume_create_manager' (5dc0fd31-16ef-4df7-83ba-d2dc92503710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606171a7-cb28-41fd-9364-fd743aa2bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606171a7-cb28-41fd-9364-fd743aa2bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-895711737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad6730a-a8b5-4e0e-85d4-21ff16963518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494379a2fc7243bf8ffa900249355984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:16Z,use_quota=True,user_id='6fc3868747994eb1996d8a5f7ab0c9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96c4ec2-a67b-4727-ba02-717bb632b81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96c4ec2-a67b-4727-ba02-717bb632b81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd922e8-80a7-453c-a712-d9e031ebdebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.image.glance [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Creating Keystone auth plugin from conf {{(pid=82391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 10:33:15 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2.57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" returned: 0 in 0.658s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-quobyte-57cc2cb5-39b1-4b73-aa25-5c96cb063d9d" released by "_delete_snapshot" :: held 2.872s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-quobyte-4771b74f-987d-41b0-a35f-358ab41198b2" released by "delete_snapshot" :: held 2.891s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:15 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58" returned: 0 in 0.634s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:15 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 is being set with open permissions: ugo+rw Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:15 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 Apr 02 10:33:15 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd922e8-80a7-453c-a712-d9e031ebdebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dad6730a-a8b5-4e0e-85d4-21ff16963518', 'volume_name': 'volume-dad6730a-a8b5-4e0e-85d4-21ff16963518', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7c9b6-99a0-419c-bfc4-33a7811f120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7c9b6-99a0-419c-bfc4-33a7811f120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2ca6c8-7ef1-44bb-a7b3-c93f3dcae523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:15 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Volume dad6730a-a8b5-4e0e-85d4-21ff16963518: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dad6730a-a8b5-4e0e-85d4-21ff16963518', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 10:33:15 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Trying to clone dad6730a-a8b5-4e0e-85d4-21ff16963518 from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d at location (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]). {{(pid=82391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Created reservations ['73ddfac8-bf40-4b7b-bace-09670ea4fc4f', '9f13e814-d3e2-4f9b-a92b-69a5b1ee0c76', '85ea578a-f86c-49a7-8862-81f5251b816d', 'd7e44d62-df5f-44b7-a9d5-37ff9b78901a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Delete snapshot completed successfully. Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-39a9f100-7129-463e-83a2-0abc65bf9d3b tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-57cc2cb5-39b1-4b73-aa25-5c96cb063d9d-delete_snapshot" released by "delete_snapshot" :: held 3.134s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "cinder-4771b74f-987d-41b0-a35f-358ab41198b2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 10:33:16 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Image download 20.69 MB at 20.69 MB/s Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-4771b74f-987d-41b0-a35f-358ab41198b2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1c4c90-a05c-47e9-a006-eaf0a80c9aab]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "cinder-quobyte-4771b74f-987d-41b0-a35f-358ab41198b2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-quobyte-4771b74f-987d-41b0-a35f-358ab41198b2" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c8964-ba79-4e01-9f09-e9876d371267]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:16 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD Apr 02 10:33:16 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:16 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 Apr 02 10:33:16 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:16 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58" returned: 0 in 0.582s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:16 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info Apr 02 10:33:16 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:17 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2" returned: 0 in 0.804s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:17 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d is fetched for user 6fc3868747994eb1996d8a5f7ab0c9d7. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 10:33:17 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2 Apr 02 10:33:17 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:17 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info" returned: 0 in 0.754s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:17 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info is being set with open permissions: ugo+rw Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[775dd2f7-ab5b-4afd-88e2-8bd1560b619d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:17 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info Apr 02 10:33:17 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:17 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD Apr 02 10:33:17 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:17 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4771b74f-987d-41b0-a35f-358ab41198b2" returned: 0 in 0.516s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-quobyte-4771b74f-987d-41b0-a35f-358ab41198b2" released by "delete_volume" :: held 1.364s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Created reservations ['18b03d5e-a810-451a-9162-0799857dd022', 'e69f027c-4dfa-4aa4-b5c3-de35ddfea4dc', '9913a96a-4edd-4dd8-964e-5d511073a259', '5c7bdf8c-ab37-4f5e-8db5-97c2e3041daa'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:17 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:17 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:17 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.info" returned: 0 in 0.624s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.044s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8de13aa9-f965-4cc9-9e26-b5514b8d3d3c tempest-VolumeDependencyTests-1403225744 None] Create snapshot completed successfully Apr 02 10:33:18 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD" returned: 0 in 0.667s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-895711737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad6730a-a8b5-4e0e-85d4-21ff16963518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='494379a2fc7243bf8ffa900249355984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:16Z,use_quota=True,user_id='6fc3868747994eb1996d8a5f7ab0c9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Creating volume dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:18 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:18 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 1073741824 Apr 02 10:33:18 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:18 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.537s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Deleted volume successfully. Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6b4defa5-6512-4cae-95d6-a687ba7fd89a tempest-SnapshotMetadataTestJSON-816803835 None] Lock "cinder-4771b74f-987d-41b0-a35f-358ab41198b2-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (cbad2e85-b81c-4c67-8c53-29b99ef8a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96450974-9faa-46ab-a440-ed2156b93e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96450974-9faa-46ab-a440-ed2156b93e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1105934987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca79843a-2518-4463-bc70-cad5615ea99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d5a58fd3024c79a5a18aebc95f07e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=125f659f-f787-4c54-8841-f4a1eafbbe58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:18Z,use_quota=True,user_id='db04e3de4ca04274adbec010f2cacda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57d02e6-3b26-4adc-aadf-bf155a7d88ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57d02e6-3b26-4adc-aadf-bf155a7d88ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17beb90-03ef-4d5f-a133-ec93f06e7d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17beb90-03ef-4d5f-a133-ec93f06e7d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca79843a-2518-4463-bc70-cad5615ea99b', 'volume_name': 'volume-ca79843a-2518-4463-bc70-cad5615ea99b', 'volume_size': 1, 'snapshot_id': '125f659f-f787-4c54-8841-f4a1eafbbe58'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd95751-855c-4c10-96f7-c8f804c5dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd95751-855c-4c10-96f7-c8f804c5dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456082d2-da7d-4959-a8b0-3e6882991b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:18 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Volume ca79843a-2518-4463-bc70-cad5615ea99b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca79843a-2518-4463-bc70-cad5615ea99b', 'volume_size': 1, 'snapshot_id': '125f659f-f787-4c54-8841-f4a1eafbbe58'} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:18 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 1073741824" returned: 0 in 0.681s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:18 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:18 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:19 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.581s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-125f659f-f787-4c54-8841-f4a1eafbbe58-ca79843a-2518-4463-bc70-cad5615ea99b" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-125f659f-f787-4c54-8841-f4a1eafbbe58-ca79843a-2518-4463-bc70-cad5615ea99b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Creating volume ca79843a-2518-4463-bc70-cad5615ea99b from snapshot 125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-ca79843a-2518-4463-bc70-cad5615ea99b" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-ca79843a-2518-4463-bc70-cad5615ea99b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] snapshot: 125f659f-f787-4c54-8841-f4a1eafbbe58, volume: ca79843a-2518-4463-bc70-cad5615ea99b, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Attempting download of 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume dad6730a-a8b5-4e0e-85d4-21ff16963518. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0975c943-8b00-46d0-a442-24fd97eb7364]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ec893-abd3-4a4a-b6e8-3ad2077ef41a]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:19 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 Apr 02 10:33:19 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:19 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52 Apr 02 10:33:19 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:20 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52" returned: 0 in 0.670s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:20 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58" returned: 0 in 0.728s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f06946-001a-4cc4-8f39-2ac769782816]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:20 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52 Apr 02 10:33:20 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:20 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:20 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:20 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52" returned: 1 in 0.705s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_1317jq52' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e2fcfa-8028-47dc-944b-180fb454d0a1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:20 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.692s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:33:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:20 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b Apr 02 10:33:20 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:20 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD Apr 02 10:33:20 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Flow 'volume_create_manager' (bf40cb39-83b9-493a-9a24-51226ce0f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5d77b0-f2fe-46d1-aadb-1f876152bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5d77b0-f2fe-46d1-aadb-1f876152bf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-436008482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c744a5a1-8ced-498a-b5b7-ccb4c2268205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264281ac31eb4e9ca6085b934dd0d61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:21Z,use_quota=True,user_id='c40232eb931f43f59c24bf6d17324f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4a6066-1b82-412b-8d44-d1a114a94aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4a6066-1b82-412b-8d44-d1a114a94aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1916bcdb-7944-4de0-a1e9-636b1dac78a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1916bcdb-7944-4de0-a1e9-636b1dac78a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c744a5a1-8ced-498a-b5b7-ccb4c2268205', 'volume_name': 'volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27c7da8-3502-408f-9749-b3df7a22b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27c7da8-3502-408f-9749-b3df7a22b354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbc653f-bced-498f-9be3-85e9d480619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:21 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Volume c744a5a1-8ced-498a-b5b7-ccb4c2268205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205', 'volume_size': 1} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:21 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD" returned: 0 in 1.220s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] 25308ee5-ba0c-42b9-8fcd-f0100169d78d was qcow2, converting to raw {{(pid=82391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 10:33:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:22 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:22 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:23 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b" returned: 0 in 2.627s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:23 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[294690a6-aa26-49d9-8625-dab9371f54e9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:23 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:23 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:23 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 0 in 1.957s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:23 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_i4s2jl0_devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:33:23 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Converted 112.00 MB image at 57.19 MB/s Apr 02 10:33:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:23 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 1G Apr 02 10:33:23 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:24 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.768s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:33:24 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Converted 1024.00 MB image at 389.53 MB/s Apr 02 10:33:24 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b is being set with open permissions: ugo+rw Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:24 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b Apr 02 10:33:24 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:24 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 1G" returned: 0 in 0.539s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb70c618-a6ac-4ce3-b8c9-f3be59cdb429]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:24 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:24 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:24 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b" returned: 0 in 0.492s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-ca79843a-2518-4463-bc70-cad5615ea99b" released by "_copy_volume_from_snapshot" :: held 5.410s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-125f659f-f787-4c54-8841-f4a1eafbbe58-ca79843a-2518-4463-bc70-cad5615ea99b" released by "_create_volume_from_snapshot" :: held 5.443s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.459s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-436008482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c744a5a1-8ced-498a-b5b7-ccb4c2268205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264281ac31eb4e9ca6085b934dd0d61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:21Z,use_quota=True,user_id='c40232eb931f43f59c24bf6d17324f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Creating volume c744a5a1-8ced-498a-b5b7-ccb4c2268205 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:24 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:24 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 1073741824 Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456082d2-da7d-4959-a8b0-3e6882991b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca79843a-2518-4463-bc70-cad5615ea99b', 'volume_size': 1, 'snapshot_id': '125f659f-f787-4c54-8841-f4a1eafbbe58'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:24 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47cc30c-6764-4641-a53e-4a92d483fa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:24 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Volume volume-ca79843a-2518-4463-bc70-cad5615ea99b (ca79843a-2518-4463-bc70-cad5615ea99b): created successfully Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47cc30c-6764-4641-a53e-4a92d483fa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (cbad2e85-b81c-4c67-8c53-29b99ef8a937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6166f7d2-1040-4b01-b424-b70895bdae4e tempest-VolumeDependencyTests-1403225744 None] Created volume successfully. Apr 02 10:33:25 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 0 in 0.567s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:25 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:25 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-125f659f-f787-4c54-8841-f4a1eafbbe58-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-125f659f-f787-4c54-8841-f4a1eafbbe58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-125f659f-f787-4c54-8841-f4a1eafbbe58" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-125f659f-f787-4c54-8841-f4a1eafbbe58" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Deleting offline snapshot 125f659f-f787-4c54-8841-f4a1eafbbe58 of volume 5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] snapshot_file for this snap is: volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[498d13ab-9b34-4d21-a0ba-74ce7c26216a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:25 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 1073741824" returned: 0 in 0.706s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:25 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 Apr 02 10:33:25 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:25 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 Apr 02 10:33:25 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:25 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 1 in 0.777s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Downloaded image 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume dad6730a-a8b5-4e0e-85d4-21ff16963518 successfully. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d for user 6fc3868747994eb1996d8a5f7ab0c9d7 is deleted. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Marking volume dad6730a-a8b5-4e0e-85d4-21ff16963518 as bootable. {{(pid=82391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Copying metadata from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d to dad6730a-a8b5-4e0e-85d4-21ff16963518. {{(pid=82391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Creating volume glance metadata for volume dad6730a-a8b5-4e0e-85d4-21ff16963518 backed by image 25308ee5-ba0c-42b9-8fcd-f0100169d78d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 10:33:25 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205" returned: 0 in 0.505s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbc653f-bced-498f-9be3-85e9d480619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfb8537-f5d1-40ec-8021-f2422c255c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:25 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58" returned: 0 in 0.578s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad7abc0-caaf-4da2-a5ed-6e77b6c169ae]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:25 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Volume volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 (c744a5a1-8ced-498a-b5b7-ccb4c2268205): created successfully Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfb8537-f5d1-40ec-8021-f2422c255c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Flow 'volume_create_manager' (bf40cb39-83b9-493a-9a24-51226ce0f45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e1ff6b6e-c921-4de2-8fda-1d3682e3231a tempest-VolumesMetadataTest-1627344282 None] Created volume successfully. Apr 02 10:33:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2ca6c8-7ef1-44bb-a7b3-c93f3dcae523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad6730a-a8b5-4e0e-85d4-21ff16963518', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5dc574-3d61-4367-af99-05cadbe32f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:26 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Volume volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 (dad6730a-a8b5-4e0e-85d4-21ff16963518): created successfully Apr 02 10:33:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5dc574-3d61-4367-af99-05cadbe32f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Flow 'volume_create_manager' (5dc0fd31-16ef-4df7-83ba-d2dc92503710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2779fdfb-94ba-445f-9104-daf7e8604aad tempest-VolumesImageMetadata-2041049407 None] Created volume successfully. Apr 02 10:33:26 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:26 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:26 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.656s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:26 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 Apr 02 10:33:26 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Acquiring lock "cinder-dad6730a-a8b5-4e0e-85d4-21ff16963518-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Lock "cinder-dad6730a-a8b5-4e0e-85d4-21ff16963518-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Acquiring lock "cinder-c744a5a1-8ced-498a-b5b7-ccb4c2268205-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Lock "cinder-c744a5a1-8ced-498a-b5b7-ccb4c2268205-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Acquiring lock "cinder-quobyte-dad6730a-a8b5-4e0e-85d4-21ff16963518" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Lock "cinder-quobyte-dad6730a-a8b5-4e0e-85d4-21ff16963518" acquired by "delete_volume" :: waited 0.023s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Acquiring lock "cinder-quobyte-c744a5a1-8ced-498a-b5b7-ccb4c2268205" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f072d-b99b-4b75-a263-7c4690b294e8]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Lock "cinder-quobyte-c744a5a1-8ced-498a-b5b7-ccb4c2268205" acquired by "delete_volume" :: waited 0.025s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e175241-a8f2-4b3c-b289-e1bffc13ad82]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:27 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:27 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:27 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58" returned: 0 in 0.662s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:27 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 Apr 02 10:33:27 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:27 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58 Apr 02 10:33:27 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:27 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 0 in 0.500s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:27 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:27 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:27 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5.125f659f-f787-4c54-8841-f4a1eafbbe58" returned: 0 in 0.488s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:27 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-125f659f-f787-4c54-8841-f4a1eafbbe58" released by "_delete_snapshot" :: held 2.476s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205" returned: 0 in 0.602s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" released by "delete_snapshot" :: held 2.508s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:27 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205 Apr 02 10:33:27 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Created reservations ['77787c28-dab5-4b63-b80d-31ff79a2b242', '9ff15050-cb51-4ea7-993d-f8b0182afad2', '181ff473-972a-4040-88e2-b32c9581f44d', 'd2b54b2d-8a37-4070-90c2-2056ea320406'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Delete snapshot completed successfully. Apr 02 10:33:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7f4de121-43c0-4ce5-9577-1af8a135cfc9 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-125f659f-f787-4c54-8841-f4a1eafbbe58-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:28 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 1 in 0.580s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:28 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518 Apr 02 10:33:28 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:28 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c744a5a1-8ced-498a-b5b7-ccb4c2268205" returned: 0 in 0.529s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Lock "cinder-quobyte-c744a5a1-8ced-498a-b5b7-ccb4c2268205" released by "delete_volume" :: held 1.162s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Created reservations ['87433790-2f9d-498f-b0bc-101dea8114e6', '13401372-86a4-4db3-9076-db95a42942eb', 'c60a1039-0feb-4cdd-9667-f677340c4450', '8d0cc282-9120-490a-bc93-56c5ab035291'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:28 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:28 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca9ddb-fe64-4547-8bdb-9e26f9db613d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:28 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:28 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:28 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-dad6730a-a8b5-4e0e-85d4-21ff16963518" returned: 0 in 0.552s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Lock "cinder-quobyte-dad6730a-a8b5-4e0e-85d4-21ff16963518" released by "delete_volume" :: held 1.688s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Created reservations ['88a85326-da94-4b29-a69f-ab4dd1545163', '19d08abe-d8ad-4340-ae03-e9a768f165d8', '3b01b89a-b1e4-4756-8137-e46e5d9a06c1', 'a8bdea63-a1fe-4529-81dc-5f5edb86f868'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:28 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:28 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:29 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.543s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:29 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Deleted volume successfully. Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f0e5fde-1746-4b27-9fa5-d4509d183cd8 tempest-VolumesMetadataTest-1627344282 None] Lock "cinder-c744a5a1-8ced-498a-b5b7-ccb4c2268205-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:29 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.652s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:29 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5 Apr 02 10:33:29 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:29 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.518s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:29 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Deleted volume successfully. Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c8804516-993b-442f-a309-27aeaedba809 tempest-VolumesImageMetadata-2041049407 None] Lock "cinder-dad6730a-a8b5-4e0e-85d4-21ff16963518-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:29 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" returned: 0 in 0.561s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5" released by "delete_volume" :: held 1.244s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Created reservations ['e3e12464-b91a-466d-9337-139bb7a4c126', '5e6eb7b9-d982-473b-b122-622045980e85', '69b6d7dd-b3a1-4fcb-9791-62f6f92e3501', 'a192c357-8aef-4943-b680-4e694b2273c1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:29 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:29 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:30 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.556s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:30 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Deleted volume successfully. Apr 02 10:33:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a5b07a1a-e16f-4996-ac48-942341048a82 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-5d886d5d-d3e2-47a7-b29c-55bcfc8707a5-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:30 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (bec56b17-f11e-4a05-a12c-4b1222b6603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3718cad6-3090-4d07-a74e-55045328d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3718cad6-3090-4d07-a74e-55045328d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1601657899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de18f4f-9090-4f97-a62d-abfdfce54007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d5a58fd3024c79a5a18aebc95f07e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:31Z,use_quota=True,user_id='db04e3de4ca04274adbec010f2cacda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c441ca-b6f8-441e-a106-ffa726422fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c441ca-b6f8-441e-a106-ffa726422fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9360832-a495-4d8c-9a6b-a8b78296ac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9360832-a495-4d8c-9a6b-a8b78296ac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de18f4f-9090-4f97-a62d-abfdfce54007', 'volume_name': 'volume-1de18f4f-9090-4f97-a62d-abfdfce54007', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaedd19-cf66-4a93-ad49-91f40f538c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaedd19-cf66-4a93-ad49-91f40f538c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7463223a-73ce-4795-9d7d-047ab9114598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:31 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Volume 1de18f4f-9090-4f97-a62d-abfdfce54007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de18f4f-9090-4f97-a62d-abfdfce54007', 'volume_size': 1} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1601657899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de18f4f-9090-4f97-a62d-abfdfce54007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d5a58fd3024c79a5a18aebc95f07e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:31Z,use_quota=True,user_id='db04e3de4ca04274adbec010f2cacda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Creating volume 1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:31 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:31 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 1073741824 Apr 02 10:33:31 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:31 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 1073741824" returned: 0 in 0.688s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:31 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:31 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:32 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.614s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7463223a-73ce-4795-9d7d-047ab9114598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de18f4f-9090-4f97-a62d-abfdfce54007', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20aaaa8f-1f28-4cd1-bfac-2b6077788060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Flow 'volume_create_manager' (cc1bb2d4-e4e5-43ac-a2bb-c2e9355fcd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d6dfa1-5c52-41ab-a712-9f422154ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Volume volume-1de18f4f-9090-4f97-a62d-abfdfce54007 (1de18f4f-9090-4f97-a62d-abfdfce54007): created successfully Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20aaaa8f-1f28-4cd1-bfac-2b6077788060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (bec56b17-f11e-4a05-a12c-4b1222b6603f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d6dfa1-5c52-41ab-a712-9f422154ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-729065380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b857f5d3-b00f-4252-bc48-9f7422486203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d9817cbdce427b8ef28ea870be3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:32Z,use_quota=True,user_id='1bd8d356f422483b9b16b0dbd687a0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc045b85-1656-4806-931a-0aa5dfc4b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc045b85-1656-4806-931a-0aa5dfc4b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6caeb2-13c2-4204-bb10-89c2c58b0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6caeb2-13c2-4204-bb10-89c2c58b0677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b857f5d3-b00f-4252-bc48-9f7422486203', 'volume_name': 'volume-b857f5d3-b00f-4252-bc48-9f7422486203', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a409852-1f0c-49d0-a8c4-9c2e6579e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a409852-1f0c-49d0-a8c4-9c2e6579e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cce65bb-4b3d-4158-95eb-e0c1528e8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Volume b857f5d3-b00f-4252-bc48-9f7422486203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b857f5d3-b00f-4252-bc48-9f7422486203', 'volume_size': 1} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-729065380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b857f5d3-b00f-4252-bc48-9f7422486203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d9817cbdce427b8ef28ea870be3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:32Z,use_quota=True,user_id='1bd8d356f422483b9b16b0dbd687a0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Creating volume b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:32 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:32 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-aed15745-ade1-4d6b-b23a-13e8a877d0f6 tempest-VolumeDependencyTests-1403225744 None] Created volume successfully. Apr 02 10:33:32 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 1073741824 Apr 02 10:33:32 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Flow 'volume_create_manager' (2ec3d8b6-59b9-43b8-96fe-7f66859e3d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff380ab6-8bd9-4b2a-b244-dabc1ddb51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff380ab6-8bd9-4b2a-b244-dabc1ddb51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-260349282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1bde9-825e-4edd-a9d0-252e6f9481cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76044e8677dd4c7081540848cee03f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:32Z,use_quota=True,user_id='0167eaaa3630494ebbcbbc991b4a49ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5a6fe6-d29e-4ab3-8afd-9d941538db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5a6fe6-d29e-4ab3-8afd-9d941538db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b79fd14-7c20-42b1-8f91-a605d27c3522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.image.glance [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Creating Keystone auth plugin from conf {{(pid=82391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b79fd14-7c20-42b1-8f91-a605d27c3522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56c1bde9-825e-4edd-a9d0-252e6f9481cb', 'volume_name': 'volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875c28e8-76a6-46cf-81ce-1076602c32c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875c28e8-76a6-46cf-81ce-1076602c32c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e89d6f5-0399-4a00-8fac-4eb9f23d6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:32 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Volume 56c1bde9-825e-4edd-a9d0-252e6f9481cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Trying to clone 56c1bde9-825e-4edd-a9d0-252e6f9481cb from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d at location (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]). {{(pid=82391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 02 10:33:32 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 02 10:33:32 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Image download 20.69 MB at 20.69 MB/s Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9404392-8081-48e7-a737-429881137345]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:33 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD Apr 02 10:33:33 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:33 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 1073741824" returned: 0 in 0.655s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:33 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:33 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:33 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.504s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cce65bb-4b3d-4158-95eb-e0c1528e8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b857f5d3-b00f-4252-bc48-9f7422486203', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:33 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad69263f-9aad-46dc-897c-ce1030808dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d is fetched for user 0167eaaa3630494ebbcbbc991b4a49ef. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 02 10:33:33 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Volume volume-b857f5d3-b00f-4252-bc48-9f7422486203 (b857f5d3-b00f-4252-bc48-9f7422486203): created successfully Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad69263f-9aad-46dc-897c-ce1030808dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Flow 'volume_create_manager' (cc1bb2d4-e4e5-43ac-a2bb-c2e9355fcd08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:33 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e6a669c8-8ef1-49e4-bca7-cafc818527fe tempest-VolumesDeleteCascade-252022137 None] Created volume successfully. Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (f38b8dc3-66bc-44e5-91dd-3f5e52448688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd26456-1833-479b-a3be-a180a7dab468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd26456-1833-479b-a3be-a180a7dab468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-853536148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a37e5c-cfb6-4369-907b-84d622c98301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d5a58fd3024c79a5a18aebc95f07e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1de18f4f-9090-4f97-a62d-abfdfce54007,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:34Z,use_quota=True,user_id='db04e3de4ca04274adbec010f2cacda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b3c2e-be30-4429-976a-71dbd77d42da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b3c2e-be30-4429-976a-71dbd77d42da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48f9971-8669-4932-bef6-b74f747a81b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2ef6f-821b-44fd-9af9-e0ea46f026b7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48f9971-8669-4932-bef6-b74f747a81b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '45a37e5c-cfb6-4369-907b-84d622c98301', 'volume_name': 'volume-45a37e5c-cfb6-4369-907b-84d622c98301', 'volume_size': 1, 'source_volid': '1de18f4f-9090-4f97-a62d-abfdfce54007', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78268787-34d7-4a14-a727-2da473094221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78268787-34d7-4a14-a727-2da473094221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d5c733-3094-4fbb-8669-f4a17246329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:33 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Volume 45a37e5c-cfb6-4369-907b-84d622c98301: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-45a37e5c-cfb6-4369-907b-84d622c98301', 'volume_size': 1, 'source_volid': '1de18f4f-9090-4f97-a62d-abfdfce54007', 'source_volstatus': 'available'} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:33 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Cloning volume 1de18f4f-9090-4f97-a62d-abfdfce54007 to volume 45a37e5c-cfb6-4369-907b-84d622c98301 Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Creating offline snapshot aed63b6a-da5f-434f-8367-0ab614d91bef of volume 1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[700e526e-0e69-4f19-bc6d-302ee3b6e9b8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:34 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD Apr 02 10:33:34 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:34 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:34 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:34 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.536s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:34 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef 1G Apr 02 10:33:34 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:34 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD" returned: 0 in 0.699s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:35 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef 1G" returned: 0 in 0.619s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de18f4f-9090-4f97-a62d-abfdfce54007 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:35 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de18f4f-9090-4f97-a62d-abfdfce54007 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef Apr 02 10:33:35 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:35 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de18f4f-9090-4f97-a62d-abfdfce54007 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef" returned: 0 in 0.573s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:35 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef is being set with open permissions: ugo+rw Apr 02 10:33:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:35 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef Apr 02 10:33:35 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:36 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef" returned: 0 in 0.506s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:36 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info Apr 02 10:33:36 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:36 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info" returned: 0 in 0.452s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:36 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info is being set with open permissions: ugo+rw Apr 02 10:33:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:36 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info Apr 02 10:33:36 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:37 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.info" returned: 0 in 0.514s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-45a37e5c-cfb6-4369-907b-84d622c98301" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-45a37e5c-cfb6-4369-907b-84d622c98301" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] snapshot: aed63b6a-da5f-434f-8367-0ab614d91bef, volume: 45a37e5c-cfb6-4369-907b-84d622c98301, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9913f368-62cb-461c-9665-27ea3812b8fd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:37 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef Apr 02 10:33:37 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:37 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef" returned: 0 in 0.527s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de18f4f-9090-4f97-a62d-abfdfce54007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d1a175-8cb8-48d5-bc92-a61144fd788f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:37 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:37 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:38 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.512s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:38 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:33:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:38 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 Apr 02 10:33:38 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:40 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301" returned: 0 in 2.248s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:40 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c822b4e-3ea2-4dc8-8629-ddc92172bd4e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:40 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:40 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:41 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.631s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:33:41 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Converted 1024.00 MB image at 455.13 MB/s Apr 02 10:33:41 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 is being set with open permissions: ugo+rw Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:41 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 Apr 02 10:33:41 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:41 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301" returned: 0 in 0.458s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-45a37e5c-cfb6-4369-907b-84d622c98301" released by "_copy_volume_from_snapshot" :: held 4.435s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-aed63b6a-da5f-434f-8367-0ab614d91bef" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-aed63b6a-da5f-434f-8367-0ab614d91bef" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Deleting offline snapshot aed63b6a-da5f-434f-8367-0ab614d91bef of volume 1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] snapshot_file for this snap is: volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1c462-abdf-44e7-bb59-6f53dac1b067]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:41 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef Apr 02 10:33:41 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:42 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef" returned: 0 in 0.536s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de18f4f-9090-4f97-a62d-abfdfce54007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bacf004-719b-4616-a9e1-78729822c4b9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:42 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:42 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:42 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.493s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:42 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef Apr 02 10:33:42 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:43 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef" returned: 0 in 0.506s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:43 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef Apr 02 10:33:43 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:43 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007.aed63b6a-da5f-434f-8367-0ab614d91bef" returned: 0 in 0.379s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-aed63b6a-da5f-434f-8367-0ab614d91bef" released by "_delete_snapshot" :: held 1.959s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.716s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.059s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-260349282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1bde9-825e-4edd-a9d0-252e6f9481cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76044e8677dd4c7081540848cee03f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:32Z,use_quota=True,user_id='0167eaaa3630494ebbcbbc991b4a49ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Creating volume 56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:43 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d5c733-3094-4fbb-8669-f4a17246329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a37e5c-cfb6-4369-907b-84d622c98301', 'volume_size': 1, 'source_volid': '1de18f4f-9090-4f97-a62d-abfdfce54007', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:43 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 1073741824 Apr 02 10:33:43 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59457c10-fd9c-4c62-8f8d-ba69da1ff24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:43 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Volume volume-45a37e5c-cfb6-4369-907b-84d622c98301 (45a37e5c-cfb6-4369-907b-84d622c98301): created successfully Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59457c10-fd9c-4c62-8f8d-ba69da1ff24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Flow 'volume_create_manager' (f38b8dc3-66bc-44e5-91dd-3f5e52448688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9631a286-715d-4eb9-abde-656fbd8e286f tempest-VolumeDependencyTests-1403225744 None] Created volume successfully. Apr 02 10:33:44 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 1073741824" returned: 0 in 0.489s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:44 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:44 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-1de18f4f-9090-4f97-a62d-abfdfce54007-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-1de18f4f-9090-4f97-a62d-abfdfce54007-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-1de18f4f-9090-4f97-a62d-abfdfce54007" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-1de18f4f-9090-4f97-a62d-abfdfce54007" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[365758b3-604b-4c77-b03e-9a747d6abeb7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:44 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:44 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:44 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 0 in 0.513s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.916s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Creating offline snapshot 8cfa7caf-4b38-48f4-8f58-02f78fab67c9 of volume b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Attempting download of 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume 56c1bde9-825e-4edd-a9d0-252e6f9481cb. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[265117c9-eeae-4bb2-a03a-e90288a3b279]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b728b8-255c-4d86-a97e-5aaad9e2d0b1]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:44 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:44 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:44 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q Apr 02 10:33:44 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:45 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.586s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:45 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007 Apr 02 10:33:45 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:45 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.509s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:45 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 1G Apr 02 10:33:45 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:45 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q" returned: 0 in 0.500s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:45 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q Apr 02 10:33:45 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:45 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1de18f4f-9090-4f97-a62d-abfdfce54007" returned: 0 in 0.434s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-1de18f4f-9090-4f97-a62d-abfdfce54007" released by "delete_volume" :: held 1.052s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Created reservations ['4051b933-bc60-4c9d-bc45-a9409c4b1f69', '163a1057-e970-4192-845f-b564c8dbd847', 'ee5e427d-bc1e-4094-b9f5-60c0c2c20b5a', '31092ddc-aca8-493f-87cc-48dbecb652a9'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:45 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:45 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:45 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 1G" returned: 0 in 0.542s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:45 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q" returned: 1 in 0.527s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25308ee5-ba0c-42b9-8fcd-f0100169d78d_kfhdk30q' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37076376-85fd-4ae4-8903-ae88d834b2e5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:45 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:45 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:45 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD Apr 02 10:33:45 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:46 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.495s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:46 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Deleted volume successfully. Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5da07f4b-dd10-495e-9ecb-825419ae3ec6 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-1de18f4f-9090-4f97-a62d-abfdfce54007-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:46 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.415s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:46 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 is being set with open permissions: ugo+rw Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:46 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:46 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:46 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] 25308ee5-ba0c-42b9-8fcd-f0100169d78d was qcow2, converting to raw {{(pid=82391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 02 10:33:46 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:46 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:46 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:46 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:46 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.404s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-45a37e5c-cfb6-4369-907b-84d622c98301-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:46 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-45a37e5c-cfb6-4369-907b-84d622c98301-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.436s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:46 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info Apr 02 10:33:46 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-45a37e5c-cfb6-4369-907b-84d622c98301" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-45a37e5c-cfb6-4369-907b-84d622c98301" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5506a3-78f0-49bd-b165-57bd34b2d585]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:46 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 Apr 02 10:33:46 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:47 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info" returned: 0 in 0.571s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:47 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:47 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info is being set with open permissions: ugo+rw Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 0 in 0.981s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25308ee5-ba0c-42b9-8fcd-f0100169d78d_jm93t_eudevstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:33:47 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Converted 112.00 MB image at 109.44 MB/s Apr 02 10:33:47 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:47 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:47 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 1G Apr 02 10:33:47 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:47 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301" returned: 0 in 0.624s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:47 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301 Apr 02 10:33:47 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:47 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.info" returned: 0 in 0.590s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:47 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5d95a9eb-a1a7-42fa-8fb1-c6032b385a17 tempest-VolumesDeleteCascade-252022137 None] Create snapshot completed successfully Apr 02 10:33:47 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45a37e5c-cfb6-4369-907b-84d622c98301" returned: 0 in 0.551s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-45a37e5c-cfb6-4369-907b-84d622c98301" released by "delete_volume" :: held 1.210s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Created reservations ['37856e32-2bd0-46f6-a90b-487a5b35ae89', '2f476154-ca47-461d-bf4e-414cc901d123', '21370e1d-5b62-4b43-a53f-281b724daaf0', 'de654db3-cd6b-411b-ae52-76a1be9cb2f7'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:48 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:48 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:48 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 1G" returned: 0 in 0.768s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[417a5e1f-96e8-4aac-8fcc-ce0f4c01f1cc]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:48 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:48 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Creating offline snapshot eb8b617c-3d48-4cd6-88c6-a3f5fb382594 of volume b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:33:48 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.519s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Deleted volume successfully. Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e847d1b9-2c37-4899-a6c4-46e7e20379e5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9fd05283-fe6c-4ec0-879a-c80502077964 tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-45a37e5c-cfb6-4369-907b-84d622c98301-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:48 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:48 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-ca79843a-2518-4463-bc70-cad5615ea99b-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-ca79843a-2518-4463-bc70-cad5615ea99b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:48 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 0 in 0.825s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "cinder-quobyte-ca79843a-2518-4463-bc70-cad5615ea99b" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-ca79843a-2518-4463-bc70-cad5615ea99b" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac66000-44fa-4ea0-bd12-31598d0340ab]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:49 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:49 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:49 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b Apr 02 10:33:49 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:49 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.605s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b857f5d3-b00f-4252-bc48-9f7422486203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:49 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 1G Apr 02 10:33:49 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:49 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b" returned: 0 in 0.613s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:49 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b Apr 02 10:33:49 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:49 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 1 in 0.738s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Downloaded image 25308ee5-ba0c-42b9-8fcd-f0100169d78d ((None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}])) to volume 56c1bde9-825e-4edd-a9d0-252e6f9481cb successfully. {{(pid=82391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Temporary image 25308ee5-ba0c-42b9-8fcd-f0100169d78d for user 0167eaaa3630494ebbcbbc991b4a49ef is deleted. {{(pid=82391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.volume_utils [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Marking volume 56c1bde9-825e-4edd-a9d0-252e6f9481cb as bootable. {{(pid=82391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Copying metadata from image 25308ee5-ba0c-42b9-8fcd-f0100169d78d to 56c1bde9-825e-4edd-a9d0-252e6f9481cb. {{(pid=82391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Creating volume glance metadata for volume 56c1bde9-825e-4edd-a9d0-252e6f9481cb backed by image 25308ee5-ba0c-42b9-8fcd-f0100169d78d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e89d6f5-0399-4a00-8fac-4eb9f23d6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb', 'volume_size': 1, 'image_id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fac6879e8db74c22ae33357f6153480b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25308ee5-ba0c-42b9-8fcd-f0100169d78d', 'created_at': datetime.datetime(2026, 4, 2, 8, 22, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 22, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25308ee5-ba0c-42b9-8fcd-f0100169d78d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3cf710-70f3-4ab6-ab89-eed86723c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:49 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Volume volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb (56c1bde9-825e-4edd-a9d0-252e6f9481cb): created successfully Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f3cf710-70f3-4ab6-ab89-eed86723c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Flow 'volume_create_manager' (2ec3d8b6-59b9-43b8-96fe-7f66859e3d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:49 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e3da98d9-a992-49d6-ae53-3c49c07da246 tempest-VolumesExtendTest-1993907690 None] Created volume successfully. Apr 02 10:33:49 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 1G" returned: 0 in 0.710s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:49 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 Apr 02 10:33:49 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (a634e89e-bc37-4871-922e-362332ce915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad044e5-8483-460e-a3ee-791eba7f8bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad044e5-8483-460e-a3ee-791eba7f8bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-6935195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47db75a-b191-42a7-8421-2de75bb1fff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:50Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe4373c-385a-43ff-b29c-313e8cdca2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe4373c-385a-43ff-b29c-313e8cdca2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20b0836-f600-49cc-aa3c-e9be85ab5a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20b0836-f600-49cc-aa3c-e9be85ab5a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47db75a-b191-42a7-8421-2de75bb1fff6', 'volume_name': 'volume-e47db75a-b191-42a7-8421-2de75bb1fff6', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc09b677-896d-446a-8f82-5e453eed0b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc09b677-896d-446a-8f82-5e453eed0b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48b2c77-fe9d-4386-a444-64f3f799b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Volume e47db75a-b191-42a7-8421-2de75bb1fff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47db75a-b191-42a7-8421-2de75bb1fff6', 'volume_size': 1} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:50 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ca79843a-2518-4463-bc70-cad5615ea99b" returned: 0 in 0.624s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-quobyte-ca79843a-2518-4463-bc70-cad5615ea99b" released by "delete_volume" :: held 1.262s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Created reservations ['0a3f92f7-ba6f-4579-8161-213d5862eb59', '72a39db6-9143-4a30-b1b0-fb0d05da559a', 'f53de051-da3f-476c-bb5a-1d34f186e513', '8ca36c5e-6ecd-41f0-a112-53299d900db1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:50 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:50 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:50 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594" returned: 0 in 0.556s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:50 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 is being set with open permissions: ugo+rw Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:50 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 Apr 02 10:33:50 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:50 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.407s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Deleted volume successfully. Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ff01339a-7631-4c06-bb89-086f62b157ea tempest-VolumeDependencyTests-1403225744 None] Lock "cinder-ca79843a-2518-4463-bc70-cad5615ea99b-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:50 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-6935195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47db75a-b191-42a7-8421-2de75bb1fff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:50Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Creating volume e47db75a-b191-42a7-8421-2de75bb1fff6 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:50 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:50 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 1073741824 Apr 02 10:33:50 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5f5b9a3e-7939-469d-8b81-0ca6ec76c7ed tempest-VolumesDeleteCascade-252022137 None] Create snapshot completed successfully Apr 02 10:33:51 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 1073741824" returned: 0 in 0.552s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:51 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 Apr 02 10:33:51 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-b857f5d3-b00f-4252-bc48-9f7422486203-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-b857f5d3-b00f-4252-bc48-9f7422486203-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Performing cascade delete. {{(pid=82391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-8cfa7caf-4b38-48f4-8f58-02f78fab67c9-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-8cfa7caf-4b38-48f4-8f58-02f78fab67c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-8cfa7caf-4b38-48f4-8f58-02f78fab67c9" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-8cfa7caf-4b38-48f4-8f58-02f78fab67c9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Deleting offline snapshot 8cfa7caf-4b38-48f4-8f58-02f78fab67c9 of volume b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] snapshot_file for this snap is: volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1242ce8-ccf6-4473-9be7-80ce6558180f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:51 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:51 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:52 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6" returned: 0 in 0.700s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.674s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48b2c77-fe9d-4386-a444-64f3f799b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47db75a-b191-42a7-8421-2de75bb1fff6', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e3d85a-42f2-4a13-9dda-ac1b65be0515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b546f-ce2f-4764-8e52-0c17b3130699]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:52 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Volume volume-e47db75a-b191-42a7-8421-2de75bb1fff6 (e47db75a-b191-42a7-8421-2de75bb1fff6): created successfully Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e3d85a-42f2-4a13-9dda-ac1b65be0515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (a634e89e-bc37-4871-922e-362332ce915e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f336b55f-3e37-4a7c-ba9d-0abd7f5f897c tempest-VolumesActionsTest-953991986 None] Created volume successfully. Apr 02 10:33:52 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:52 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:52 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.640s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b857f5d3-b00f-4252-bc48-9f7422486203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b637dfed-ca60-4bf8-91a0-1093604ed09c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:52 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:52 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:52 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 0 in 0.534s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:52 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:52 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:53 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c53660-7603-4df0-84c2-f211d44b453c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:53 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 Apr 02 10:33:53 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:53 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 1 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 2G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-20f9c6bc-198b-4847-8eb5-0ccbbfb17ce8 tempest-VolumesActionsTest-953991986 None] Acquiring lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6" by "attach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-20f9c6bc-198b-4847-8eb5-0ccbbfb17ce8 tempest-VolumesActionsTest-953991986 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6" acquired by "attach_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=199,cinder:DELETE=17,cinder:SELECT=154,cinder:INSERT=56 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb 2G" returned: 0 in 0.080s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.140s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-20f9c6bc-198b-4847-8eb5-0ccbbfb17ce8 tempest-VolumesActionsTest-953991986 None] Attaching volume e47db75a-b191-42a7-8421-2de75bb1fff6 to instance ee381d6b-e5f3-41c5-9436-f33e01b82abf at mountpoint /dev/vdb on host None. Apr 02 10:33:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-20f9c6bc-198b-4847-8eb5-0ccbbfb17ce8 tempest-VolumesActionsTest-953991986 None] Attach volume completed successfully. Apr 02 10:33:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4635e44f-6d50-4452-8671-e804fb2ab9d6 tempest-VolumesExtendTest-1993907690 None] Extend volume completed successfully. Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-20f9c6bc-198b-4847-8eb5-0ccbbfb17ce8 tempest-VolumesActionsTest-953991986 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6" released by "attach_volume" :: held 0.100s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:53 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594" returned: 0 in 0.508s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b857f5d3-b00f-4252-bc48-9f7422486203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc493f2-2c36-4e18-834c-392c9120f71d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:53 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:53 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-56c1bde9-825e-4edd-a9d0-252e6f9481cb-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Lock "cinder-56c1bde9-825e-4edd-a9d0-252e6f9481cb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-quobyte-56c1bde9-825e-4edd-a9d0-252e6f9481cb" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-56c1bde9-825e-4edd-a9d0-252e6f9481cb" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:54 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.631s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b857f5d3-b00f-4252-bc48-9f7422486203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbeff8-b33f-4b4a-b122-290538e5315e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1924e034-b18a-4e90-aff9-0c8d2033ce85]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:54 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:54 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:54 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:54 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-86adc9ea-207e-4965-ab72-b6cb6c748a8e tempest-VolumesActionsTest-1402711125 None] Terminate volume connection completed successfully. Apr 02 10:33:54 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 0 in 0.503s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:54 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.550s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:54 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:54 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:54 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:54 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-86adc9ea-207e-4965-ab72-b6cb6c748a8e tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-detach_volume" by "detach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-86adc9ea-207e-4965-ab72-b6cb6c748a8e tempest-VolumesActionsTest-1402711125 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-86adc9ea-207e-4965-ab72-b6cb6c748a8e tempest-VolumesActionsTest-1402711125 None] Detaching volume e47db75a-b191-42a7-8421-2de75bb1fff6 from instance ee381d6b-e5f3-41c5-9436-f33e01b82abf. Apr 02 10:33:55 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-86adc9ea-207e-4965-ab72-b6cb6c748a8e tempest-VolumesActionsTest-1402711125 None] Detach volume completed successfully. Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-86adc9ea-207e-4965-ab72-b6cb6c748a8e tempest-VolumesActionsTest-1402711125 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:55 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 1 in 0.548s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:55 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.533s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:55 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb Apr 02 10:33:55 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:55 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9 Apr 02 10:33:55 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65547ca7-9266-425d-87e5-a269d7a803a5 tempest-VolumesActionsTest-953991986 None] Acquiring lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-detach_volume" by "detach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65547ca7-9266-425d-87e5-a269d7a803a5 tempest-VolumesActionsTest-953991986 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:55 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-65547ca7-9266-425d-87e5-a269d7a803a5 tempest-VolumesActionsTest-953991986 None] Volume detach called, but volume not attached. Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-65547ca7-9266-425d-87e5-a269d7a803a5 tempest-VolumesActionsTest-953991986 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:55 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-56c1bde9-825e-4edd-a9d0-252e6f9481cb" returned: 0 in 0.463s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-56c1bde9-825e-4edd-a9d0-252e6f9481cb" released by "delete_volume" :: held 1.585s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Created reservations ['7bc7213f-1798-46dc-8728-31b04b1be0b5', 'af6d0479-451d-4557-871b-412fcc5d14d4', 'a9654805-97f5-4c0c-b778-62df6a0685ac', 'f2874339-2a5a-44d3-9ffd-ff929a5d80d3'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:55 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.8cfa7caf-4b38-48f4-8f58-02f78fab67c9" returned: 0 in 0.519s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 -F qcow2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:55 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 -F qcow2 Apr 02 10:33:55 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:55 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:55 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:56 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.489s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Deleted volume successfully. Apr 02 10:33:56 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97d7d472-5662-4b26-a0cc-3494658dcbab tempest-VolumesExtendTest-1993907690 None] Lock "cinder-56c1bde9-825e-4edd-a9d0-252e6f9481cb-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b857f5d3-b00f-4252-bc48-9f7422486203 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 -F qcow2" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Acquiring lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-8cfa7caf-4b38-48f4-8f58-02f78fab67c9" released by "_delete_snapshot" :: held 4.540s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" released by "delete_snapshot" :: held 4.558s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Acquiring lock "cinder-quobyte-e47db75a-b191-42a7-8421-2de75bb1fff6" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Created reservations ['ce06870d-4eff-46fe-8cd1-d11972e98d59', '7a34b38e-19ca-4a00-9ce5-c686494c2900', '29801850-661a-4cdd-8cb2-c1b663e08bc6', 'e9fa56f0-35e7-4926-b6a5-ccc705a8be17'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Lock "cinder-quobyte-e47db75a-b191-42a7-8421-2de75bb1fff6" acquired by "delete_volume" :: waited 0.032s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec8ecc-82f9-491b-970e-011cf9ed23b1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Delete snapshot completed successfully. Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-8cfa7caf-4b38-48f4-8f58-02f78fab67c9-delete_snapshot" released by "delete_snapshot" :: held 4.762s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-eb8b617c-3d48-4cd6-88c6-a3f5fb382594-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-eb8b617c-3d48-4cd6-88c6-a3f5fb382594-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-eb8b617c-3d48-4cd6-88c6-a3f5fb382594" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-eb8b617c-3d48-4cd6-88c6-a3f5fb382594" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Deleting offline snapshot eb8b617c-3d48-4cd6-88c6-a3f5fb382594 of volume b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] snapshot_file for this snap is: volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:33:56 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 Apr 02 10:33:56 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09373a-44cc-4140-ab00-b59b8ef54cfc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Flow 'volume_create_manager' (22839b99-ba46-4f1e-ba4c-93f516e0fd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6eb310-475f-44d1-a197-fcb329d8b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6eb310-475f-44d1-a197-fcb329d8b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1531540853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18525217-958d-4c31-b39e-212fcd2f599f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76044e8677dd4c7081540848cee03f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:57Z,use_quota=True,user_id='0167eaaa3630494ebbcbbc991b4a49ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563cfbae-987c-4eba-bfce-fa3076489cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563cfbae-987c-4eba-bfce-fa3076489cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de586aeb-64d7-4a1b-92fb-9c551984ae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:56 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 Apr 02 10:33:56 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de586aeb-64d7-4a1b-92fb-9c551984ae50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18525217-958d-4c31-b39e-212fcd2f599f', 'volume_name': 'volume-18525217-958d-4c31-b39e-212fcd2f599f', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4069c838-1cd9-4cbd-9843-0bb87588647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4069c838-1cd9-4cbd-9843-0bb87588647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a8e64d-3f23-4938-ae30-eaf3863fb5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:56 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Volume 18525217-958d-4c31-b39e-212fcd2f599f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18525217-958d-4c31-b39e-212fcd2f599f', 'volume_size': 1} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1531540853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18525217-958d-4c31-b39e-212fcd2f599f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76044e8677dd4c7081540848cee03f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:57Z,use_quota=True,user_id='0167eaaa3630494ebbcbbc991b4a49ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Creating volume 18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:33:56 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:33:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:56 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f 1073741824 Apr 02 10:33:56 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:57 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6" returned: 0 in 0.632s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:57 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6 Apr 02 10:33:57 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:57 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594" returned: 0 in 0.497s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b857f5d3-b00f-4252-bc48-9f7422486203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828cf32-e586-49bb-b27a-7d434308152b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:57 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:57 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:57 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f 1073741824" returned: 0 in 0.552s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:57 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f Apr 02 10:33:57 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:57 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e47db75a-b191-42a7-8421-2de75bb1fff6" returned: 0 in 0.542s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Lock "cinder-quobyte-e47db75a-b191-42a7-8421-2de75bb1fff6" released by "delete_volume" :: held 1.210s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Created reservations ['d347afbe-5c3b-42fc-b79f-b9318d0cbc99', '82e4edf5-bed9-4e88-8cbb-798e892ff140', 'bacac251-f8b4-4b47-b6b3-4eb41467b6a2', '4db512ed-0466-43af-a630-afa30b78f381'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:33:57 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.597s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:57 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:33:57 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:57 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 Apr 02 10:33:57 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:57 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f" returned: 0 in 0.499s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a8e64d-3f23-4938-ae30-eaf3863fb5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18525217-958d-4c31-b39e-212fcd2f599f', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ba2f7e-256c-4c0b-bf09-e58ee3069cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:33:57 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Volume volume-18525217-958d-4c31-b39e-212fcd2f599f (18525217-958d-4c31-b39e-212fcd2f599f): created successfully Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ba2f7e-256c-4c0b-bf09-e58ee3069cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:33:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Flow 'volume_create_manager' (22839b99-ba46-4f1e-ba4c-93f516e0fd89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:33:57 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-025c7f89-50c9-4b5c-b7f5-c4555e6e2d98 tempest-VolumesExtendTest-1993907690 None] Created volume successfully. Apr 02 10:33:58 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.435s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:33:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Deleted volume successfully. Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fba5ce38-7948-4f0a-a6fa-07a5ad5b4420 tempest-VolumesActionsTest-953991986 None] Lock "cinder-e47db75a-b191-42a7-8421-2de75bb1fff6-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:58 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594" returned: 0 in 0.490s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:58 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594 Apr 02 10:33:58 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:58 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203.eb8b617c-3d48-4cd6-88c6-a3f5fb382594" returned: 0 in 0.441s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-eb8b617c-3d48-4cd6-88c6-a3f5fb382594" released by "_delete_snapshot" :: held 2.128s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" released by "delete_snapshot" :: held 2.146s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Created reservations ['01fc7a18-09b2-4fd8-8c58-56ff6e485034', '0c79e79f-a890-4b42-8015-1df0c1860669', '150f18ed-646b-4536-8bfe-c3a348ede1e3', 'e5b1ae7b-14a0-4555-99b5-793d04472a8d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:33:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Delete snapshot completed successfully. Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-eb8b617c-3d48-4cd6-88c6-a3f5fb382594-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Snapshots deleted, issuing volume delete {{(pid=82391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6e290-61e1-415e-be4b-05bce79e31c8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Creating offline snapshot 3e91a53b-ba74-4633-9307-87f9352f4a4e of volume 18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef736c88-0060-40d4-bbc2-24842a59a775]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:33:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:59 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:59 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:59 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f Apr 02 10:33:59 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:59 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f" returned: 0 in 0.547s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:59 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 02 10:33:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.624s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:33:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:33:59 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e 1G Apr 02 10:33:59 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:33:59 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203 Apr 02 10:33:59 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:00 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e 1G" returned: 0 in 0.672s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18525217-958d-4c31-b39e-212fcd2f599f -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:00 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b857f5d3-b00f-4252-bc48-9f7422486203" returned: 0 in 0.680s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:00 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18525217-958d-4c31-b39e-212fcd2f599f -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e Apr 02 10:34:00 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-b857f5d3-b00f-4252-bc48-9f7422486203" released by "delete_volume" :: held 1.355s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Created reservations ['e691f9bc-344c-47f1-b930-c17ef25e5b71', 'cdc58098-5e0c-471e-a56b-098b36859c88', 'fe7bbdad-cf2a-46b8-83f5-22b9a3b32461', '054cd243-8972-4121-9d21-a9c8b4dded70'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:00 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:00 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:00 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18525217-958d-4c31-b39e-212fcd2f599f -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e" returned: 0 in 0.540s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:00 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e is being set with open permissions: ugo+rw Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:00 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e Apr 02 10:34:00 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:00 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.421s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Deleted volume successfully. Apr 02 10:34:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f1ea32c0-8155-4f4e-9b99-eb9694f173ef tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-b857f5d3-b00f-4252-bc48-9f7422486203-delete_volume" released by "delete_volume" :: held 9.101s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:01 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e" returned: 0 in 0.413s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:01 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info Apr 02 10:34:01 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Flow 'volume_create_manager' (34409d12-914c-4bbe-bb8b-c754fd1d844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeb6d67-d290-4ee3-a6d0-a2dddd46405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:01 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeb6d67-d290-4ee3-a6d0-a2dddd46405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1389807933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6c4fdc-4f04-4010-84b8-1be452b54689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d9817cbdce427b8ef28ea870be3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:02Z,use_quota=True,user_id='1bd8d356f422483b9b16b0dbd687a0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fa9527-6172-42e5-be34-6b0eabcbf377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fa9527-6172-42e5-be34-6b0eabcbf377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc06efe7-9ba0-47e3-bc8e-963185c44cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc06efe7-9ba0-47e3-bc8e-963185c44cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6c4fdc-4f04-4010-84b8-1be452b54689', 'volume_name': 'volume-9a6c4fdc-4f04-4010-84b8-1be452b54689', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f0d557-7fde-467b-9963-3431c8ee16fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f0d557-7fde-467b-9963-3431c8ee16fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1776c54b-d6bf-415a-b509-968916cbe29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Volume 9a6c4fdc-4f04-4010-84b8-1be452b54689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6c4fdc-4f04-4010-84b8-1be452b54689', 'volume_size': 1} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info" returned: 0 in 0.543s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:01 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info is being set with open permissions: ugo+rw Apr 02 10:34:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:01 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info Apr 02 10:34:01 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:02 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.info" returned: 0 in 0.420s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1389807933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6c4fdc-4f04-4010-84b8-1be452b54689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d9817cbdce427b8ef28ea870be3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:02Z,use_quota=True,user_id='1bd8d356f422483b9b16b0dbd687a0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Creating volume 9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:02 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:02 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 1073741824 Apr 02 10:34:02 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e0c38480-83b4-4bb7-a0ce-95be96acad95 tempest-VolumesExtendTest-1993907690 None] Create snapshot completed successfully Apr 02 10:34:02 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:02 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 1073741824" returned: 0 in 0.502s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:02 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:02 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:03 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.416s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1776c54b-d6bf-415a-b509-968916cbe29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6c4fdc-4f04-4010-84b8-1be452b54689', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3844e9-f890-4a3e-aa06-ae8f6575bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:03 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Volume volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 (9a6c4fdc-4f04-4010-84b8-1be452b54689): created successfully Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3844e9-f890-4a3e-aa06-ae8f6575bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Flow 'volume_create_manager' (34409d12-914c-4bbe-bb8b-c754fd1d844a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5ed344df-ceab-40de-8c36-7efc6c8c4885 tempest-VolumesDeleteCascade-252022137 None] Created volume successfully. Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e43d5af-d79b-4dc2-a073-54ed2f75e87e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:03 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f Apr 02 10:34:03 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:03 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f" returned: 0 in 0.508s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e 2G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e 2G" returned: 0 in 0.098s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.632s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:03 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f2377933-159f-4a22-8f16-f8e68b58ad2c tempest-VolumesExtendTest-1993907690 None] Extend volume completed successfully. Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Creating offline snapshot e3441010-e61b-45f5-abe8-1b8a31226a54 of volume 9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79aa0e8-0064-4dca-9b87-7de1c107031b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:04 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:04 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-3e91a53b-ba74-4633-9307-87f9352f4a4e-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:04 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-3e91a53b-ba74-4633-9307-87f9352f4a4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-quobyte-18525217-958d-4c31-b39e-212fcd2f599f" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.490s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-18525217-958d-4c31-b39e-212fcd2f599f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-quobyte-3e91a53b-ba74-4633-9307-87f9352f4a4e" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:04 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 1G Apr 02 10:34:04 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-3e91a53b-ba74-4633-9307-87f9352f4a4e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Deleting offline snapshot 3e91a53b-ba74-4633-9307-87f9352f4a4e of volume 18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] snapshot_file for this snap is: volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832f3d0-6af1-4ded-8a54-d7346eae375a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:04 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e Apr 02 10:34:04 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:04 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 1G" returned: 0 in 0.543s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:04 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 Apr 02 10:34:04 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:05 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e" returned: 0 in 0.540s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18525217-958d-4c31-b39e-212fcd2f599f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (ec86562c-de5a-4220-ad60-f22d6c58b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756e3282-70b1-487c-bc0e-d76f725f9418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d648439f-8e47-43ab-bf17-2a04b600e5f7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756e3282-70b1-487c-bc0e-d76f725f9418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160206966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a378e33c-057f-4b6f-9e5b-890ad4d5d031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:05Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c169715-8f7d-4b8c-a458-c02a7adb358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c169715-8f7d-4b8c-a458-c02a7adb358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7452325-a5be-4d5c-8cab-d6a957352f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7452325-a5be-4d5c-8cab-d6a957352f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a378e33c-057f-4b6f-9e5b-890ad4d5d031', 'volume_name': 'volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c2c9a3-2980-410f-8339-6a16032b9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c2c9a3-2980-410f-8339-6a16032b9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3e71da-ca59-4ced-9c4a-ed6695d075af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:05 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Volume a378e33c-057f-4b6f-9e5b-890ad4d5d031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031', 'volume_size': 1} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:05 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f Apr 02 10:34:05 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:05 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54" returned: 0 in 0.423s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:05 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 is being set with open permissions: ugo+rw Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:05 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 Apr 02 10:34:05 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:05 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f" returned: 0 in 0.462s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:05 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e Apr 02 10:34:05 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:05 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54" returned: 0 in 0.390s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:05 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info Apr 02 10:34:05 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:05 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e" returned: 0 in 0.438s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:05 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e Apr 02 10:34:05 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:06 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info" returned: 0 in 0.406s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:06 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info is being set with open permissions: ugo+rw Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:06 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info Apr 02 10:34:06 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:06 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f.3e91a53b-ba74-4633-9307-87f9352f4a4e" returned: 0 in 0.409s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-3e91a53b-ba74-4633-9307-87f9352f4a4e" released by "_delete_snapshot" :: held 1.930s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-18525217-958d-4c31-b39e-212fcd2f599f" released by "delete_snapshot" :: held 1.944s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Created reservations ['48bbea32-a9fa-4682-9d17-d08bdbc6ee4f', '11b8d183-caae-40b5-a043-c1021ec3fda8', 'b140d5ad-c3b7-4bac-b22b-ce4afe9acd00', '5d7684f3-66c2-445c-b75f-17199831b6a1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Delete snapshot completed successfully. Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61b41f34-0124-4a0a-80bb-f3bb908f18c4 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-3e91a53b-ba74-4633-9307-87f9352f4a4e-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-18525217-958d-4c31-b39e-212fcd2f599f-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-18525217-958d-4c31-b39e-212fcd2f599f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "cinder-quobyte-18525217-958d-4c31-b39e-212fcd2f599f" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-18525217-958d-4c31-b39e-212fcd2f599f" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db419a-c6b6-4dfb-8c74-f92f18e99b49]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:06 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.info" returned: 0 in 0.448s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-160206966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a378e33c-057f-4b6f-9e5b-890ad4d5d031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:05Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Creating volume a378e33c-057f-4b6f-9e5b-890ad4d5d031 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:06 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:06 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 1073741824 Apr 02 10:34:06 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6a0399ab-fd69-404f-bbc1-9a0a09219ae6 tempest-VolumesDeleteCascade-252022137 None] Create snapshot completed successfully Apr 02 10:34:06 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f Apr 02 10:34:06 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:07 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f" returned: 0 in 0.514s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:07 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f Apr 02 10:34:07 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:07 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 1073741824" returned: 0 in 0.508s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:07 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 Apr 02 10:34:07 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Flow 'volume_create_manager' (09169709-dcd6-43b1-803e-2f5b2108bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e514cad4-88e3-42b3-94d2-855682bfd2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e514cad4-88e3-42b3-94d2-855682bfd2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1872040735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cdbe77-d8d8-48a3-9ad4-f74f111889f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d9817cbdce427b8ef28ea870be3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3441010-e61b-45f5-abe8-1b8a31226a54,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:07Z,use_quota=True,user_id='1bd8d356f422483b9b16b0dbd687a0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68ed11a-189e-49c7-ac30-041d2293c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68ed11a-189e-49c7-ac30-041d2293c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082a6fcc-fbcb-4f05-87a2-e3c60f29ccaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082a6fcc-fbcb-4f05-87a2-e3c60f29ccaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33cdbe77-d8d8-48a3-9ad4-f74f111889f0', 'volume_name': 'volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0', 'volume_size': 1, 'snapshot_id': 'e3441010-e61b-45f5-abe8-1b8a31226a54'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c93d4de-fd9f-45af-afaa-96e4a6a28862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c93d4de-fd9f-45af-afaa-96e4a6a28862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e138a6-b0cf-43cf-8683-82e49f9ac839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:07 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Volume 33cdbe77-d8d8-48a3-9ad4-f74f111889f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0', 'volume_size': 1, 'snapshot_id': 'e3441010-e61b-45f5-abe8-1b8a31226a54'} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:07 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18525217-958d-4c31-b39e-212fcd2f599f" returned: 0 in 0.421s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-quobyte-18525217-958d-4c31-b39e-212fcd2f599f" released by "delete_volume" :: held 0.962s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Created reservations ['06629ab9-bc15-48ec-9c42-ee2d55014cea', '32f4d068-e359-4a18-94c7-1f32cc845c4d', '8f0c7e26-b831-4724-b954-410cffeefcef', 'df72595a-346b-4371-93c9-b831507724d0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:07 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031" returned: 0 in 0.460s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.257s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-e3441010-e61b-45f5-abe8-1b8a31226a54-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:07 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:07 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3e71da-ca59-4ced-9c4a-ed6695d075af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f7b73d-535c-484e-828c-3ff26bb88c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-e3441010-e61b-45f5-abe8-1b8a31226a54-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Creating volume 33cdbe77-d8d8-48a3-9ad4-f74f111889f0 from snapshot e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:07 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Volume volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 (a378e33c-057f-4b6f-9e5b-890ad4d5d031): created successfully Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f7b73d-535c-484e-828c-3ff26bb88c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (ec86562c-de5a-4220-ad60-f22d6c58b1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:07 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ef0cb282-0e55-43ee-8002-2c8e764ddadf tempest-VolumesActionsTest-953991986 None] Created volume successfully. Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] snapshot: e3441010-e61b-45f5-abe8-1b8a31226a54, volume: 33cdbe77-d8d8-48a3-9ad4-f74f111889f0, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ec427-9bde-4404-a7eb-b5f0dcfc45ac]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:07 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 Apr 02 10:34:07 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:08 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.434s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:08 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Deleted volume successfully. Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-fe06f048-0ef5-4cb1-813d-bce9727e4e69 tempest-VolumesExtendTest-1993907690 None] Lock "cinder-18525217-958d-4c31-b39e-212fcd2f599f-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-a378e33c-057f-4b6f-9e5b-890ad4d5d031-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Lock "cinder-a378e33c-057f-4b6f-9e5b-890ad4d5d031-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-quobyte-a378e33c-057f-4b6f-9e5b-890ad4d5d031" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-a378e33c-057f-4b6f-9e5b-890ad4d5d031" acquired by "delete_volume" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4b44f-d3f9-4ae1-b10f-7bb5f22d4e2a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:08 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54" returned: 0 in 0.593s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a6c4fdc-4f04-4010-84b8-1be452b54689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6196c319-2f5e-4cb9-a2b6-33c6c8772380]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:08 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 Apr 02 10:34:08 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:08 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:08 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:08 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031" returned: 0 in 0.562s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:08 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.558s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:34:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:08 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031 Apr 02 10:34:08 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:08 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 Apr 02 10:34:08 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:09 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a378e33c-057f-4b6f-9e5b-890ad4d5d031" returned: 0 in 0.413s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-a378e33c-057f-4b6f-9e5b-890ad4d5d031" released by "delete_volume" :: held 0.995s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Created reservations ['da3acddd-779e-449d-a139-59f9bfd69d38', '317c4749-bdf3-4652-91e0-68b8361155d1', '38c60488-b726-4909-a6af-39720b650d67', '1f289742-6a7e-497a-a580-9204043af1a1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:09 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:09 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Flow 'volume_create_manager' (40d69bb0-93c9-4896-a2ee-5fc1e9e9e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7cae7f-cef4-4eaf-8de3-5c7a79459fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7cae7f-cef4-4eaf-8de3-5c7a79459fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-247204810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adc1f19-dcaf-49f3-bc44-692a88989b68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9150fa2a07463c8181386748c6adb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:10Z,use_quota=True,user_id='fd392caa0a6b4559aa9f9c2f40799215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af030e4d-8e60-47f6-8342-8b16772e6af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af030e4d-8e60-47f6-8342-8b16772e6af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c45732-70e5-4a8a-83c0-81425f94d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c45732-70e5-4a8a-83c0-81425f94d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adc1f19-dcaf-49f3-bc44-692a88989b68', 'volume_name': 'volume-1adc1f19-dcaf-49f3-bc44-692a88989b68', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4b3883-880d-41ab-8a7e-97ab4a37f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4b3883-880d-41ab-8a7e-97ab4a37f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cab502-0b54-4297-8766-b8429fc19b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:10 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Volume 1adc1f19-dcaf-49f3-bc44-692a88989b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adc1f19-dcaf-49f3-bc44-692a88989b68', 'volume_size': 1} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:10 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.194s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:10 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Deleted volume successfully. Apr 02 10:34:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d493c1e9-ccf5-49c6-b56d-8707c91f82fb tempest-VolumesActionsTest-1402711125 None] Lock "cinder-a378e33c-057f-4b6f-9e5b-890ad4d5d031-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:11 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" returned: 0 in 2.093s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9aaf70-a9ca-4181-ac3e-c06c3f12bf37]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:11 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:11 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (62375e12-189e-442e-8786-17500d67aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a0e8ff-8eb0-4abc-a3ff-b54015ddba2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a0e8ff-8eb0-4abc-a3ff-b54015ddba2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-481246086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e119ac-f706-4976-af56-566ea6d95028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:11Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26eb1d3-d450-4e18-a04b-650c1c4111dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26eb1d3-d450-4e18-a04b-650c1c4111dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fee8823-cf98-4d57-b1f0-493dee899772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fee8823-cf98-4d57-b1f0-493dee899772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e119ac-f706-4976-af56-566ea6d95028', 'volume_name': 'volume-89e119ac-f706-4976-af56-566ea6d95028', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f38d02-6408-4e9b-9681-b8565a5fc28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f38d02-6408-4e9b-9681-b8565a5fc28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f09dc12-e80b-4500-979a-17ece00a9987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:11 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Volume 89e119ac-f706-4976-af56-566ea6d95028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e119ac-f706-4976-af56-566ea6d95028', 'volume_size': 1} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:11 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.576s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:34:11 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Converted 1024.00 MB image at 488.94 MB/s Apr 02 10:34:11 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 is being set with open permissions: ugo+rw Apr 02 10:34:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:11 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 Apr 02 10:34:11 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:12 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" returned: 0 in 0.410s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" released by "_copy_volume_from_snapshot" :: held 4.295s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-e3441010-e61b-45f5-abe8-1b8a31226a54-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" released by "_create_volume_from_snapshot" :: held 4.336s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.362s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-247204810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adc1f19-dcaf-49f3-bc44-692a88989b68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9150fa2a07463c8181386748c6adb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:10Z,use_quota=True,user_id='fd392caa0a6b4559aa9f9c2f40799215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Creating volume 1adc1f19-dcaf-49f3-bc44-692a88989b68 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:12 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:12 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 1073741824 Apr 02 10:34:12 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e138a6-b0cf-43cf-8683-82e49f9ac839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0', 'volume_size': 1, 'snapshot_id': 'e3441010-e61b-45f5-abe8-1b8a31226a54'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78aa869-699e-407c-ab78-d76281f97656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:12 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Volume volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 (33cdbe77-d8d8-48a3-9ad4-f74f111889f0): created successfully Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78aa869-699e-407c-ab78-d76281f97656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Flow 'volume_create_manager' (09169709-dcd6-43b1-803e-2f5b2108bf15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:12 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0aaace6e-5792-4a3c-9a25-1c8c9cb86a11 tempest-VolumesDeleteCascade-252022137 None] Created volume successfully. Apr 02 10:34:12 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 1073741824" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:12 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 Apr 02 10:34:12 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-9a6c4fdc-4f04-4010-84b8-1be452b54689-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-9a6c4fdc-4f04-4010-84b8-1be452b54689-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Performing cascade delete. {{(pid=82391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 02 10:34:12 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-e3441010-e61b-45f5-abe8-1b8a31226a54-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68" returned: 0 in 0.452s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.777s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-481246086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e119ac-f706-4976-af56-566ea6d95028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:11Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Creating volume 89e119ac-f706-4976-af56-566ea6d95028 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:13 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cab502-0b54-4297-8766-b8429fc19b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adc1f19-dcaf-49f3-bc44-692a88989b68', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:13 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 1073741824 Apr 02 10:34:13 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dbc833-024c-4fed-8d7c-16444c69412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-e3441010-e61b-45f5-abe8-1b8a31226a54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Volume volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 (1adc1f19-dcaf-49f3-bc44-692a88989b68): created successfully Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dbc833-024c-4fed-8d7c-16444c69412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Flow 'volume_create_manager' (40d69bb0-93c9-4896-a2ee-5fc1e9e9e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-9a6c4fdc-4f04-4010-84b8-1be452b54689" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-96fe2d6b-a657-41f8-8729-3f3389f6ef3b tempest-VolumesListTestJSON-2049634542 None] Created volume successfully. Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-9a6c4fdc-4f04-4010-84b8-1be452b54689" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-e3441010-e61b-45f5-abe8-1b8a31226a54" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-e3441010-e61b-45f5-abe8-1b8a31226a54" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Deleting offline snapshot e3441010-e61b-45f5-abe8-1b8a31226a54 of volume 9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] snapshot_file for this snap is: volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81920d2-3443-41ce-bafb-e272e46b6137]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:13 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 Apr 02 10:34:13 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:13 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 1073741824" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=172,cinder:UPDATE=168,cinder:INSERT=65,cinder:DELETE=13 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:13 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 Apr 02 10:34:13 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:13 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54" returned: 0 in 0.504s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a6c4fdc-4f04-4010-84b8-1be452b54689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e670dc-af99-4847-817c-e741aee69d3f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:13 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:13 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:13 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028" returned: 0 in 0.405s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f09dc12-e80b-4500-979a-17ece00a9987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e119ac-f706-4976-af56-566ea6d95028', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cf73e3-0699-4848-9fa5-0ffbb407a655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Volume volume-89e119ac-f706-4976-af56-566ea6d95028 (89e119ac-f706-4976-af56-566ea6d95028): created successfully Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cf73e3-0699-4848-9fa5-0ffbb407a655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (62375e12-189e-442e-8786-17500d67aad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d85b7770-aacf-47be-95c9-43bc6e74b37e tempest-VolumesActionsTest-953991986 None] Created volume successfully. Apr 02 10:34:14 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.511s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:14 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 Apr 02 10:34:14 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Flow 'volume_create_manager' (8eb1f2b4-77e1-4034-a8e4-f5606c8a6042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaac10c7-8c96-455a-91f7-40fa72b0c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaac10c7-8c96-455a-91f7-40fa72b0c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-952678113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c41072-1a9f-469a-bc8f-09608815d803,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9150fa2a07463c8181386748c6adb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:14Z,use_quota=True,user_id='fd392caa0a6b4559aa9f9c2f40799215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c13f88f-b5b4-4d04-b7f1-39329be89c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c13f88f-b5b4-4d04-b7f1-39329be89c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6a24af-ff1e-4ee4-a8cd-c18e06e8ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6a24af-ff1e-4ee4-a8cd-c18e06e8ee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c41072-1a9f-469a-bc8f-09608815d803', 'volume_name': 'volume-98c41072-1a9f-469a-bc8f-09608815d803', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c8b7b3-afad-46cb-8864-90b5cd854e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c8b7b3-afad-46cb-8864-90b5cd854e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867c327c-0e75-4c02-bc6a-c9df62369b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Volume 98c41072-1a9f-469a-bc8f-09608815d803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c41072-1a9f-469a-bc8f-09608815d803', 'volume_size': 1} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-952678113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c41072-1a9f-469a-bc8f-09608815d803,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9150fa2a07463c8181386748c6adb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:14Z,use_quota=True,user_id='fd392caa0a6b4559aa9f9c2f40799215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Creating volume 98c41072-1a9f-469a-bc8f-09608815d803 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:14 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-89e119ac-f706-4976-af56-566ea6d95028-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:14 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 1073741824 Apr 02 10:34:14 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Lock "cinder-89e119ac-f706-4976-af56-566ea6d95028-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-quobyte-89e119ac-f706-4976-af56-566ea6d95028" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-89e119ac-f706-4976-af56-566ea6d95028" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d7f6e7-9894-4441-83a2-d163b1fc55f7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:14 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54" returned: 0 in 0.528s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:14 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 Apr 02 10:34:14 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:14 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54 Apr 02 10:34:14 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:15 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 1073741824" returned: 0 in 0.517s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:15 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689.e3441010-e61b-45f5-abe8-1b8a31226a54" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:15 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 Apr 02 10:34:15 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-e3441010-e61b-45f5-abe8-1b8a31226a54" released by "_delete_snapshot" :: held 2.016s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:15 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-9a6c4fdc-4f04-4010-84b8-1be452b54689" released by "delete_snapshot" :: held 2.030s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028" returned: 0 in 0.526s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:15 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028 Apr 02 10:34:15 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Created reservations ['7626dc15-c001-415c-8e33-1b941ef6e171', 'b00f7a54-f313-49bd-9fb7-2525203adddc', '23fb67d0-6960-42f5-be09-b10be303c498', '8209803c-3197-463c-9054-209ab29e0de7'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Delete snapshot completed successfully. Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-e3441010-e61b-45f5-abe8-1b8a31226a54-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Snapshots deleted, issuing volume delete {{(pid=82391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-9a6c4fdc-4f04-4010-84b8-1be452b54689" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-9a6c4fdc-4f04-4010-84b8-1be452b54689" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48e206-d9b5-4c93-9bf6-0a6fec3320c4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:15 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:15 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:15 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867c327c-0e75-4c02-bc6a-c9df62369b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c41072-1a9f-469a-bc8f-09608815d803', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2bb0a1-7795-4111-bd9d-f3507ad148be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:15 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Volume volume-98c41072-1a9f-469a-bc8f-09608815d803 (98c41072-1a9f-469a-bc8f-09608815d803): created successfully Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2bb0a1-7795-4111-bd9d-f3507ad148be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:15 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Flow 'volume_create_manager' (8eb1f2b4-77e1-4034-a8e4-f5606c8a6042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-89e119ac-f706-4976-af56-566ea6d95028" returned: 0 in 0.415s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-89e119ac-f706-4976-af56-566ea6d95028" released by "delete_volume" :: held 0.965s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5e7c29a9-3335-4a39-aced-653e16f1d663 tempest-VolumesListTestJSON-2049634542 None] Created volume successfully. Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Created reservations ['c8efbc1f-8b7c-4e25-afb7-1b68c79e1dd8', 'c6d38641-e7f3-4618-918a-fc1889b0452a', 'f4c10b15-e354-41a3-bb72-fc538c064679', '418c0335-9548-449c-97fc-430b1b5d44dc'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:15 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:15 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:15 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.478s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:15 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689 Apr 02 10:34:15 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:16 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.379s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Deleted volume successfully. Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-80ef1fd7-1d87-4c1e-bd40-814b1102fc7a tempest-VolumesActionsTest-1402711125 None] Lock "cinder-89e119ac-f706-4976-af56-566ea6d95028-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:16 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9a6c4fdc-4f04-4010-84b8-1be452b54689" returned: 0 in 0.390s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-9a6c4fdc-4f04-4010-84b8-1be452b54689" released by "delete_volume" :: held 0.898s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Created reservations ['3ed7fc7e-afd2-40f7-b7d3-cc30989be35a', '569f857f-1da3-43d5-9917-be16f7961c76', 'e39c9f90-64fe-4faf-95cd-e4b9d61dcdea', '486b4b75-03c7-4a18-8bc1-9a7c41c0a819'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:16 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:16 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:16 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Deleted volume successfully. Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-67963fba-1e1e-4db6-ab5b-69a62c6078a5 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-9a6c4fdc-4f04-4010-84b8-1be452b54689-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Flow 'volume_create_manager' (d3ff5201-3ca1-4e1d-a833-54378d6ac059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ec408b-baac-4b72-b73a-107375be95dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ec408b-baac-4b72-b73a-107375be95dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1152347516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef679ff0-b9dd-4c27-90bd-8b42c193451c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9150fa2a07463c8181386748c6adb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:17Z,use_quota=True,user_id='fd392caa0a6b4559aa9f9c2f40799215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa28aaea-6fe1-46a0-9443-c9cf7d93a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa28aaea-6fe1-46a0-9443-c9cf7d93a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372d6766-65e5-4abf-89a0-47ac726fb6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372d6766-65e5-4abf-89a0-47ac726fb6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef679ff0-b9dd-4c27-90bd-8b42c193451c', 'volume_name': 'volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2999eb-e7f9-48b8-979c-8fbd872f01dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2999eb-e7f9-48b8-979c-8fbd872f01dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80ddec4-d2ff-4318-baf5-0785cfb471d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Volume ef679ff0-b9dd-4c27-90bd-8b42c193451c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c', 'volume_size': 1} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1152347516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef679ff0-b9dd-4c27-90bd-8b42c193451c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e9150fa2a07463c8181386748c6adb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:17Z,use_quota=True,user_id='fd392caa0a6b4559aa9f9c2f40799215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Creating volume ef679ff0-b9dd-4c27-90bd-8b42c193451c {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:16 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:16 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c 1073741824 Apr 02 10:34:16 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (69b97ae0-ded8-4c0a-8631-37209c16adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be76c5d9-5d68-45f5-a0c6-ef036e46cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be76c5d9-5d68-45f5-a0c6-ef036e46cb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1886366181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82df0c58-e547-407d-ad7a-1e4561fcdd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:17Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fe91fe-0f73-47ec-91ee-a2f8b493e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fe91fe-0f73-47ec-91ee-a2f8b493e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f553f2b-a24d-434a-b2ad-a9b6222ac082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f553f2b-a24d-434a-b2ad-a9b6222ac082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82df0c58-e547-407d-ad7a-1e4561fcdd07', 'volume_name': 'volume-82df0c58-e547-407d-ad7a-1e4561fcdd07', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e5888a-cbfd-460d-8f5c-80906de3dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e5888a-cbfd-460d-8f5c-80906de3dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda54337-1b78-42f6-89c5-554067b8a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Volume 82df0c58-e547-407d-ad7a-1e4561fcdd07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82df0c58-e547-407d-ad7a-1e4561fcdd07', 'volume_size': 1} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:17 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c 1073741824" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-33cdbe77-d8d8-48a3-9ad4-f74f111889f0-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-33cdbe77-d8d8-48a3-9ad4-f74f111889f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:17 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c Apr 02 10:34:17 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "cinder-quobyte-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd3ec4-e284-40f7-9ebb-3a4424c66b44]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:17 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 Apr 02 10:34:17 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:17 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c" returned: 0 in 0.456s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1886366181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82df0c58-e547-407d-ad7a-1e4561fcdd07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:17Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Creating volume 82df0c58-e547-407d-ad7a-1e4561fcdd07 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:17 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80ddec4-d2ff-4318-baf5-0785cfb471d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:17 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 1073741824 Apr 02 10:34:17 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a205909-5a0c-41d8-80ab-f9b7bd67c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Volume volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c (ef679ff0-b9dd-4c27-90bd-8b42c193451c): created successfully Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a205909-5a0c-41d8-80ab-f9b7bd67c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Flow 'volume_create_manager' (d3ff5201-3ca1-4e1d-a833-54378d6ac059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d00bb7eb-4d3a-47ab-9f53-c40cccdab089 tempest-VolumesListTestJSON-2049634542 None] Created volume successfully. Apr 02 10:34:17 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" returned: 0 in 0.497s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:17 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0 Apr 02 10:34:17 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:18 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 1073741824" returned: 0 in 0.513s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:18 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-quobyte-33cdbe77-d8d8-48a3-9ad4-f74f111889f0" released by "delete_volume" :: held 0.968s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:18 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 Apr 02 10:34:18 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Created reservations ['ea973650-194d-4c1b-ab91-0f0e55a5edae', '01f2767c-478a-488e-94c5-13d1e54a3ccb', 'e9c94367-bfd4-42cc-858e-705cdac6b75f', '0ab542ef-8e14-49d2-946a-a1386c7f3caa'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:18 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:18 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:18 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07" returned: 0 in 0.533s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda54337-1b78-42f6-89c5-554067b8a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82df0c58-e547-407d-ad7a-1e4561fcdd07', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503014c3-0d3e-40e2-9e60-49aabede295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:18 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Volume volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 (82df0c58-e547-407d-ad7a-1e4561fcdd07): created successfully Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503014c3-0d3e-40e2-9e60-49aabede295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (69b97ae0-ded8-4c0a-8631-37209c16adeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:19 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.504s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:19 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7de2a2de-80e6-4c58-b6c4-ad157b313da6 tempest-VolumesActionsTest-953991986 None] Created volume successfully. Apr 02 10:34:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Deleted volume successfully. Apr 02 10:34:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6e98467b-d35e-4696-9966-14daae40c2b6 tempest-VolumesDeleteCascade-252022137 None] Lock "cinder-33cdbe77-d8d8-48a3-9ad4-f74f111889f0-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-82df0c58-e547-407d-ad7a-1e4561fcdd07-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-82df0c58-e547-407d-ad7a-1e4561fcdd07-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-quobyte-82df0c58-e547-407d-ad7a-1e4561fcdd07" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-82df0c58-e547-407d-ad7a-1e4561fcdd07" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df80070-066d-4cae-8991-beeda92c8ac9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:20 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 Apr 02 10:34:20 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:21 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07" returned: 0 in 0.544s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:21 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07 Apr 02 10:34:21 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "cinder-ef679ff0-b9dd-4c27-90bd-8b42c193451c-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-ef679ff0-b9dd-4c27-90bd-8b42c193451c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "cinder-quobyte-ef679ff0-b9dd-4c27-90bd-8b42c193451c" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-quobyte-ef679ff0-b9dd-4c27-90bd-8b42c193451c" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5892bc47-e6ef-49e0-a323-c8003bbd0982]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:21 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c Apr 02 10:34:21 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:21 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-82df0c58-e547-407d-ad7a-1e4561fcdd07" returned: 0 in 0.478s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-82df0c58-e547-407d-ad7a-1e4561fcdd07" released by "delete_volume" :: held 1.047s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Created reservations ['7c5ac849-12f0-400b-be3c-c007c57b94dc', '731fe89b-16fd-40b7-a367-1bb4c43b7211', 'b52f84bf-909b-4d1b-bc38-e6484c5ea38c', 'd8617573-c67f-4113-ba4b-b9def8b5db47'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:21 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:21 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:21 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c" returned: 0 in 0.534s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:21 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c Apr 02 10:34:21 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Flow 'volume_create_manager' (24c7fbb9-4603-4c32-bdaa-f481ec5dbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b069f5-a028-4f7d-8936-490fa6a36d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b069f5-a028-4f7d-8936-490fa6a36d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-147965907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5170fe-4059-4314-ad36-3469c257e41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b83c1a681248f4b09feb522d13e0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:22Z,use_quota=True,user_id='0359f106aacb4bcfbe73e8629a9daabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0224eb60-9294-4b26-92de-ec8028115a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0224eb60-9294-4b26-92de-ec8028115a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ccb388-4337-4491-9cff-434b8615dc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ccb388-4337-4491-9cff-434b8615dc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5170fe-4059-4314-ad36-3469c257e41a', 'volume_name': 'volume-5b5170fe-4059-4314-ad36-3469c257e41a', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b231e89-5c24-4e9f-ba6f-e56fa93f186d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b231e89-5c24-4e9f-ba6f-e56fa93f186d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418ecfbe-f3be-46fc-a3b1-74953f02652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Volume 5b5170fe-4059-4314-ad36-3469c257e41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5170fe-4059-4314-ad36-3469c257e41a', 'volume_size': 1} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-147965907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5170fe-4059-4314-ad36-3469c257e41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b83c1a681248f4b09feb522d13e0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:22Z,use_quota=True,user_id='0359f106aacb4bcfbe73e8629a9daabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Creating volume 5b5170fe-4059-4314-ad36-3469c257e41a {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:22 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:22 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a 1073741824 Apr 02 10:34:22 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:22 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.499s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:22 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Deleted volume successfully. Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ef679ff0-b9dd-4c27-90bd-8b42c193451c" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-quobyte-ef679ff0-b9dd-4c27-90bd-8b42c193451c" released by "delete_volume" :: held 1.013s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-bd31e372-dcdf-4ccc-ae91-160e2cdccb46 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-82df0c58-e547-407d-ad7a-1e4561fcdd07-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Created reservations ['741e49a8-bc99-43da-9764-b9e95b8b9ab7', 'a850739b-65c6-4eb0-989f-62bd163c7815', '3aa347e1-5850-4dbb-9763-5c4ccfeb7cd6', 'ed9a790d-704a-4790-ac70-62d6f0678de3'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:22 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:22 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:22 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a 1073741824" returned: 0 in 0.553s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:22 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.441s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Deleted volume successfully. Apr 02 10:34:22 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a Apr 02 10:34:22 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-79920a17-3cfb-4089-b9d0-63c7cd262285 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-ef679ff0-b9dd-4c27-90bd-8b42c193451c-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (32fcbd9c-10ed-4c58-852b-b71dfccc3c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aade1c58-efa1-40cc-a0ca-a3b86c59f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aade1c58-efa1-40cc-a0ca-a3b86c59f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-143359092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a53a5f-a2b5-4a27-a513-21f35fcd91f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:23Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8361319d-9443-499e-b737-1a46e1698048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8361319d-9443-499e-b737-1a46e1698048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602eb661-d9e9-4fe4-b23d-42329d9d07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602eb661-d9e9-4fe4-b23d-42329d9d07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a53a5f-a2b5-4a27-a513-21f35fcd91f2', 'volume_name': 'volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2170596-3751-4e80-a2bc-1c7430787eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2170596-3751-4e80-a2bc-1c7430787eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f6b92c-e47b-4b8f-8f94-f6d28c2528a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:23 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Volume 33a53a5f-a2b5-4a27-a513-21f35fcd91f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2', 'volume_size': 1} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:23 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a" returned: 0 in 0.467s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-143359092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a53a5f-a2b5-4a27-a513-21f35fcd91f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:23Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Creating volume 33a53a5f-a2b5-4a27-a513-21f35fcd91f2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:23 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418ecfbe-f3be-46fc-a3b1-74953f02652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5170fe-4059-4314-ad36-3469c257e41a', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ecb816-78f4-4c43-a95f-ef8033159c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:23 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 1073741824 Apr 02 10:34:23 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:23 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Volume volume-5b5170fe-4059-4314-ad36-3469c257e41a (5b5170fe-4059-4314-ad36-3469c257e41a): created successfully Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ecb816-78f4-4c43-a95f-ef8033159c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Flow 'volume_create_manager' (24c7fbb9-4603-4c32-bdaa-f481ec5dbca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-bc1bca99-6364-4940-8234-c82f882715b3 tempest-VolumesTransfersTest-888200986 None] Created volume successfully. Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "cinder-98c41072-1a9f-469a-bc8f-09608815d803-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-98c41072-1a9f-469a-bc8f-09608815d803-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "cinder-quobyte-98c41072-1a9f-469a-bc8f-09608815d803" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-quobyte-98c41072-1a9f-469a-bc8f-09608815d803" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358cc3a-1074-4305-8c0f-64f13d526485]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:23 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 Apr 02 10:34:23 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:23 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 1073741824" returned: 0 in 0.524s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:23 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 Apr 02 10:34:23 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:23 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803" returned: 0 in 0.496s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:23 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803 Apr 02 10:34:23 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:24 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f6b92c-e47b-4b8f-8f94-f6d28c2528a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bc28d0-ad91-4361-b329-f64d90d5ef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:24 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Volume volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 (33a53a5f-a2b5-4a27-a513-21f35fcd91f2): created successfully Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bc28d0-ad91-4361-b329-f64d90d5ef35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (32fcbd9c-10ed-4c58-852b-b71dfccc3c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-38d3f441-819a-4f7d-af38-12ae8a439906 tempest-VolumesActionsTest-953991986 None] Created volume successfully. Apr 02 10:34:24 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-98c41072-1a9f-469a-bc8f-09608815d803" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-quobyte-98c41072-1a9f-469a-bc8f-09608815d803" released by "delete_volume" :: held 0.964s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Created reservations ['93a2802f-b8fd-4802-acea-eefb1246e117', 'b79adbb5-336b-4a44-9e98-85cba8d3ec85', '8392ecd6-3194-4403-ab2a-afceb13c6ae1', '0d9ba15b-0b67-4c9b-96c4-895b0bab7d30'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:24 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:24 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "cinder-1adc1f19-dcaf-49f3-bc44-692a88989b68-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-1adc1f19-dcaf-49f3-bc44-692a88989b68-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "cinder-quobyte-1adc1f19-dcaf-49f3-bc44-692a88989b68" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-quobyte-1adc1f19-dcaf-49f3-bc44-692a88989b68" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42265e27-d9c9-471b-89bf-4801dfe91082]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0acf7334-5eed-49b7-b397-de01c9dd5876 tempest-VolumesTransfersTest-941103277 None] Transfer volume completed successfully. Apr 02 10:34:24 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 Apr 02 10:34:24 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:24 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.440s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Deleted volume successfully. Apr 02 10:34:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b079f7a2-b40c-4578-96a0-19d53bf67bc2 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-98c41072-1a9f-469a-bc8f-09608815d803-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:25 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68" returned: 0 in 0.478s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:25 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68 Apr 02 10:34:25 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-33a53a5f-a2b5-4a27-a513-21f35fcd91f2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-33a53a5f-a2b5-4a27-a513-21f35fcd91f2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Acquiring lock "cinder-quobyte-33a53a5f-a2b5-4a27-a513-21f35fcd91f2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-33a53a5f-a2b5-4a27-a513-21f35fcd91f2" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a8e49-0d17-4b63-9023-971e418b9b70]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:25 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 Apr 02 10:34:25 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Acquiring lock "cinder-5b5170fe-4059-4314-ad36-3469c257e41a-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-5b5170fe-4059-4314-ad36-3469c257e41a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Acquiring lock "cinder-quobyte-5b5170fe-4059-4314-ad36-3469c257e41a" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-quobyte-5b5170fe-4059-4314-ad36-3469c257e41a" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1af823-f916-4ac7-ad57-0af317106e9f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:25 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a Apr 02 10:34:25 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:25 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1adc1f19-dcaf-49f3-bc44-692a88989b68" returned: 0 in 0.537s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-quobyte-1adc1f19-dcaf-49f3-bc44-692a88989b68" released by "delete_volume" :: held 1.052s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Created reservations ['c25383a9-9a45-4d20-8496-8dad951165d5', '72d00881-ca48-44be-b05d-6f60423220ae', '0c42b210-2dd1-4178-b5c4-c98fb1e05f44', '4c8a71ec-623f-4001-80cb-3bb5184e88c6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:25 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:25 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:25 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2" returned: 0 in 0.529s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:25 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2 Apr 02 10:34:25 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:25 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a" returned: 0 in 0.502s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:26 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a Apr 02 10:34:26 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:26 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.398s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Deleted volume successfully. Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f240850-0155-4539-9fd2-8fc5b6d33352 tempest-VolumesListTestJSON-2049634542 None] Lock "cinder-1adc1f19-dcaf-49f3-bc44-692a88989b68-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:26 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-33a53a5f-a2b5-4a27-a513-21f35fcd91f2" returned: 0 in 0.398s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-quobyte-33a53a5f-a2b5-4a27-a513-21f35fcd91f2" released by "delete_volume" :: held 0.953s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Created reservations ['ee97249e-62fc-4d67-bc10-070dcec59d87', 'a34de995-1868-4cf2-91f0-a159eeaa52f4', 'be7ce3f5-8bc6-4949-bc07-4cd64c1018f9', 'a94d6fc9-46a7-4ab4-b8a9-3b3ed5b9e31f'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:26 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:26 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:26 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5b5170fe-4059-4314-ad36-3469c257e41a" returned: 0 in 0.434s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-quobyte-5b5170fe-4059-4314-ad36-3469c257e41a" released by "delete_volume" :: held 0.963s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Created reservations ['943f8344-d8bd-42ac-8c50-826fde580f03', 'fa51bf25-5c62-4cd7-8635-2e3a2c355738', '66054945-fffc-414c-9f11-0bc281ea631b', 'bfc7f129-0ae5-488a-a217-40d96312532b'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:26 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:26 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (4fde72b9-4372-4bfd-9368-f560532a5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4028186b-d878-4e78-b1a1-e5401c7390e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4028186b-d878-4e78-b1a1-e5401c7390e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010573127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8987cdd1-8208-467e-889c-7c8bc7697462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:27Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710cc6a6-75b7-4fae-a495-324a6a13dd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710cc6a6-75b7-4fae-a495-324a6a13dd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6415b328-2fa1-400f-974b-19ff2e63748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6415b328-2fa1-400f-974b-19ff2e63748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8987cdd1-8208-467e-889c-7c8bc7697462', 'volume_name': 'volume-8987cdd1-8208-467e-889c-7c8bc7697462', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2d6408-f9da-49e6-bee9-4a7ff02d2eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2d6408-f9da-49e6-bee9-4a7ff02d2eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace72a16-52ff-4cc9-96bf-e9f4867f8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:26 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Volume 8987cdd1-8208-467e-889c-7c8bc7697462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8987cdd1-8208-467e-889c-7c8bc7697462', 'volume_size': 1} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1010573127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8987cdd1-8208-467e-889c-7c8bc7697462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9dceb61bdd483890095628bbb6d607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:27Z,use_quota=True,user_id='7644f0291f4f4c3095e578f9d14abc59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Creating volume 8987cdd1-8208-467e-889c-7c8bc7697462 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:26 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:26 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 1073741824 Apr 02 10:34:26 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:26 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.532s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Deleted volume successfully. Apr 02 10:34:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c3827d3d-e2a8-401d-9d89-15b9cbefd694 tempest-VolumesActionsTest-1402711125 None] Lock "cinder-33a53a5f-a2b5-4a27-a513-21f35fcd91f2-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Flow 'volume_create_manager' (fef61d78-196a-457b-b9d8-5fa562e5c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8454f603-5ec8-464e-b349-a0c36d5140e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:27 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.511s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Deleted volume successfully. Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8454f603-5ec8-464e-b349-a0c36d5140e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-972265262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd65233f-eb86-484f-a8b6-eaf3d2f5ffac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b83c1a681248f4b09feb522d13e0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:27Z,use_quota=True,user_id='0359f106aacb4bcfbe73e8629a9daabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f2b5ad-854d-433c-94b9-d9960d24ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f2b5ad-854d-433c-94b9-d9960d24ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a521ad-6d5c-4a57-934f-dffe7fdd348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a521ad-6d5c-4a57-934f-dffe7fdd348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd65233f-eb86-484f-a8b6-eaf3d2f5ffac', 'volume_name': 'volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7648729-93e9-46b8-9719-9910b437cade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7648729-93e9-46b8-9719-9910b437cade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e76c6df-8b99-4e69-8bbe-2a1bff688ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:27 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Volume fd65233f-eb86-484f-a8b6-eaf3d2f5ffac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac', 'volume_size': 1} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-84d94a3f-4de2-4f24-826e-1a043523531c tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-5b5170fe-4059-4314-ad36-3469c257e41a-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:27 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 1073741824" returned: 0 in 0.635s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:27 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 Apr 02 10:34:27 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:27 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462" returned: 0 in 0.485s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-972265262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd65233f-eb86-484f-a8b6-eaf3d2f5ffac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b83c1a681248f4b09feb522d13e0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:27Z,use_quota=True,user_id='0359f106aacb4bcfbe73e8629a9daabc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Creating volume fd65233f-eb86-484f-a8b6-eaf3d2f5ffac {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:27 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace72a16-52ff-4cc9-96bf-e9f4867f8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8987cdd1-8208-467e-889c-7c8bc7697462', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:27 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac 1073741824 Apr 02 10:34:27 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773a231c-2b55-43e5-a8a0-4997b50ff1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:27 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Volume volume-8987cdd1-8208-467e-889c-7c8bc7697462 (8987cdd1-8208-467e-889c-7c8bc7697462): created successfully Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773a231c-2b55-43e5-a8a0-4997b50ff1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Flow 'volume_create_manager' (4fde72b9-4372-4bfd-9368-f560532a5418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-33066677-bbd7-4890-9668-aed28a12d1af tempest-VolumesActionsTest-953991986 None] Created volume successfully. Apr 02 10:34:28 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac 1073741824" returned: 0 in 0.525s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:28 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac Apr 02 10:34:28 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Flow 'volume_create_manager' (b76caac3-0cd9-4dc7-bad0-15aab879a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1813cfa9-d619-4781-bb35-6563372789e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:28 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e76c6df-8b99-4e69-8bbe-2a1bff688ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d07537e-087a-4622-a5db-495e1c3e59e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1813cfa9-d619-4781-bb35-6563372789e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-931935233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43738a3a-aed9-4f79-839c-f5964c1f83f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75bf4c49b114fe0b890f62848e647d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:29Z,use_quota=True,user_id='2d62979b0d5e41529ba2a932d0a6be95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a546eeb-aa6d-48c7-880d-130120849f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a546eeb-aa6d-48c7-880d-130120849f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b1a6b1-aac2-4999-9731-47431ee28c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b1a6b1-aac2-4999-9731-47431ee28c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43738a3a-aed9-4f79-839c-f5964c1f83f9', 'volume_name': 'volume-43738a3a-aed9-4f79-839c-f5964c1f83f9', 'volume_size': 2}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a6e9a0-1b44-4510-b917-36445e5b4a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a6e9a0-1b44-4510-b917-36445e5b4a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48e9d7d-c3f9-4b13-9d35-4f822d0ee11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:28 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Volume 43738a3a-aed9-4f79-839c-f5964c1f83f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43738a3a-aed9-4f79-839c-f5964c1f83f9', 'volume_size': 2} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-931935233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43738a3a-aed9-4f79-839c-f5964c1f83f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75bf4c49b114fe0b890f62848e647d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:29Z,use_quota=True,user_id='2d62979b0d5e41529ba2a932d0a6be95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Creating volume 43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:28 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 2147483648 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:28 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Volume volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac (fd65233f-eb86-484f-a8b6-eaf3d2f5ffac): created successfully Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d07537e-087a-4622-a5db-495e1c3e59e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:28 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 2147483648 Apr 02 10:34:28 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Flow 'volume_create_manager' (fef61d78-196a-457b-b9d8-5fa562e5c180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:28 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0f6c3dfa-6a18-4b87-8b62-495c48ec0e1d tempest-VolumesTransfersTest-888200986 None] Created volume successfully. Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Acquiring lock "cinder-8987cdd1-8208-467e-889c-7c8bc7697462-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Lock "cinder-8987cdd1-8208-467e-889c-7c8bc7697462-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Acquiring lock "cinder-quobyte-8987cdd1-8208-467e-889c-7c8bc7697462" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Lock "cinder-quobyte-8987cdd1-8208-467e-889c-7c8bc7697462" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[753039ff-fe2c-436d-a0ca-710e5bdbe7f9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:29 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 Apr 02 10:34:29 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:29 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 2147483648" returned: 0 in 0.559s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:29 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 Apr 02 10:34:29 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Acquiring lock "cinder-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Acquiring lock "cinder-quobyte-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-quobyte-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a6ffd-c29c-46e0-94c5-938ca1c31876]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:29 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac Apr 02 10:34:29 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:29 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462" returned: 0 in 0.513s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:29 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462 Apr 02 10:34:29 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:29 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9" returned: 0 in 0.418s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48e9d7d-c3f9-4b13-9d35-4f822d0ee11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43738a3a-aed9-4f79-839c-f5964c1f83f9', 'volume_size': 2}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94f4ac2-5761-417d-8726-db1494af44ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:29 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Volume volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 (43738a3a-aed9-4f79-839c-f5964c1f83f9): created successfully Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94f4ac2-5761-417d-8726-db1494af44ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Flow 'volume_create_manager' (b76caac3-0cd9-4dc7-bad0-15aab879a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:29 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6f6764e1-d5b7-4508-967d-b024e58655c8 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Created volume successfully. Apr 02 10:34:30 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:30 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac Apr 02 10:34:30 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:30 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-8987cdd1-8208-467e-889c-7c8bc7697462" returned: 0 in 0.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Lock "cinder-quobyte-8987cdd1-8208-467e-889c-7c8bc7697462" released by "delete_volume" :: held 0.943s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Created reservations ['96fe85dc-8c2c-47ec-b9ee-0b4dd25253d8', '5e0c3f0a-0c21-4c03-86ba-937405afa7ae', 'f535d0cf-4fc9-4795-b92e-6757170cf302', '573b6937-a3a3-48b7-96c6-4107de1188c4'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:30 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:30 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:30 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac" returned: 0 in 0.421s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-quobyte-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac" released by "delete_volume" :: held 0.909s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Created reservations ['83d33b65-51ab-41a0-8be3-97a8003b0686', '2166ec38-74ba-41ee-9c0e-1d899772afd0', 'f47cb3b0-5505-4148-a03a-8f231e7df4d0', '13783ed5-930a-4b78-a3fe-ea6d67e95913'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:30 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:30 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:30 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Deleted volume successfully. Apr 02 10:34:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7a850349-21d6-4b72-8e4c-041b5223b87e tempest-VolumesActionsTest-953991986 None] Lock "cinder-8987cdd1-8208-467e-889c-7c8bc7697462-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:31 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.547s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:31 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Deleted volume successfully. Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c483c7be-725f-4a6f-88e7-09c6072d6227 tempest-VolumesTransfersTest-2067827574 None] Lock "cinder-fd65233f-eb86-484f-a8b6-eaf3d2f5ffac-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Creating offline snapshot 73983e7f-503d-4bec-8a7c-33656bc99bcf of volume 43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297dfef-c8f4-4b3b-bfa6-2a32a0783579]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:31 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 Apr 02 10:34:31 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:31 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9" returned: 0 in 0.534s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf 2G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:31 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf 2G Apr 02 10:34:31 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:32 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf 2G" returned: 0 in 0.597s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:32 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf Apr 02 10:34:32 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:32 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf" returned: 0 in 0.514s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:32 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf is being set with open permissions: ugo+rw Apr 02 10:34:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:32 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf Apr 02 10:34:32 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:33 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf" returned: 0 in 0.515s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:33 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info Apr 02 10:34:33 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:33 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:33 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info is being set with open permissions: ugo+rw Apr 02 10:34:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:33 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info Apr 02 10:34:33 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:34 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.info" returned: 0 in 0.486s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:34 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3b89192c-2bf1-40d3-9aaf-65c79a6e8044 tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Create snapshot completed successfully Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "cinder-73983e7f-503d-4bec-8a7c-33656bc99bcf-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-73983e7f-503d-4bec-8a7c-33656bc99bcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "cinder-quobyte-43738a3a-aed9-4f79-839c-f5964c1f83f9" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-quobyte-43738a3a-aed9-4f79-839c-f5964c1f83f9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "cinder-quobyte-73983e7f-503d-4bec-8a7c-33656bc99bcf" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-quobyte-73983e7f-503d-4bec-8a7c-33656bc99bcf" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Deleting offline snapshot 73983e7f-503d-4bec-8a7c-33656bc99bcf of volume 43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] snapshot_file for this snap is: volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3c1d9-06fc-4e4c-88a0-bc6391237754]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:35 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf Apr 02 10:34:35 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:36 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf" returned: 0 in 0.586s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43738a3a-aed9-4f79-839c-f5964c1f83f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Flow 'volume_create_manager' (7789cf02-9913-4bef-936a-81d968efed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47859b5f-4a72-4441-8ce4-109c2b6db6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70558e-74ba-407f-9faf-ceb5957a156b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47859b5f-4a72-4441-8ce4-109c2b6db6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2094250298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec8be0c-de27-4e8b-8982-e7fb39aa0847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c1948cb7294bd993545b1edfa4f7c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:36Z,use_quota=True,user_id='d48ce3e7e378483d85f1305c0ec29872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1604c02-3f84-4a5a-ae15-c92aeefa0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1604c02-3f84-4a5a-ae15-c92aeefa0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ca8965-78a3-4810-91ec-e273f9a87fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ca8965-78a3-4810-91ec-e273f9a87fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec8be0c-de27-4e8b-8982-e7fb39aa0847', 'volume_name': 'volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33f18ce-03e7-40ad-8ca4-6c14083d79b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33f18ce-03e7-40ad-8ca4-6c14083d79b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841a5950-b327-453c-851b-13ccd9cab3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:36 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Volume bec8be0c-de27-4e8b-8982-e7fb39aa0847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847', 'volume_size': 1} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2094250298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec8be0c-de27-4e8b-8982-e7fb39aa0847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c1948cb7294bd993545b1edfa4f7c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:36Z,use_quota=True,user_id='d48ce3e7e378483d85f1305c0ec29872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Creating volume bec8be0c-de27-4e8b-8982-e7fb39aa0847 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:36 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:36 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 1073741824 Apr 02 10:34:36 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:36 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 Apr 02 10:34:36 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:36 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 1073741824" returned: 0 in 0.511s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:36 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 Apr 02 10:34:36 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:36 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9" returned: 0 in 0.564s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:36 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf Apr 02 10:34:36 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:37 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847" returned: 0 in 0.468s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841a5950-b327-453c-851b-13ccd9cab3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5801fa26-0399-4067-a2d6-893837cc6d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:37 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Volume volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 (bec8be0c-de27-4e8b-8982-e7fb39aa0847): created successfully Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5801fa26-0399-4067-a2d6-893837cc6d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Flow 'volume_create_manager' (7789cf02-9913-4bef-936a-81d968efed00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a4adddb0-1721-4f58-a357-07c833479e4b tempest-VolumesTransfersV357Test-1589605104 None] Created volume successfully. Apr 02 10:34:37 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf" returned: 0 in 0.520s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:37 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf Apr 02 10:34:37 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:37 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9.73983e7f-503d-4bec-8a7c-33656bc99bcf" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-quobyte-73983e7f-503d-4bec-8a7c-33656bc99bcf" released by "_delete_snapshot" :: held 2.256s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-quobyte-43738a3a-aed9-4f79-839c-f5964c1f83f9" released by "delete_snapshot" :: held 2.270s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Created reservations ['3cd45f04-99c9-4957-ac7e-fa2d779cc842', '0685bc86-0aed-4724-953e-7cc4170b4dcf', '920e1100-6133-48f7-8273-3e988838805a', '7e481e39-20d6-4107-add4-4000b53b5a17'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Delete snapshot completed successfully. Apr 02 10:34:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-869ce64f-f57d-4c5a-8e86-c5b16394771e tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-73983e7f-503d-4bec-8a7c-33656bc99bcf-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "cinder-43738a3a-aed9-4f79-839c-f5964c1f83f9-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-43738a3a-aed9-4f79-839c-f5964c1f83f9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "cinder-quobyte-43738a3a-aed9-4f79-839c-f5964c1f83f9" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-quobyte-43738a3a-aed9-4f79-839c-f5964c1f83f9" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:38 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e579a8f-6e7c-4722-90f0-e6e7b0c6ae97]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9b696661-8086-49bf-8c29-9cd0465d52c9 tempest-VolumesTransfersV357Test-1588776285 None] Transfer volume completed successfully. Apr 02 10:34:38 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 Apr 02 10:34:38 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:39 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9" returned: 0 in 0.619s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:39 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9 Apr 02 10:34:39 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Acquiring lock "cinder-bec8be0c-de27-4e8b-8982-e7fb39aa0847-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-bec8be0c-de27-4e8b-8982-e7fb39aa0847-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Acquiring lock "cinder-quobyte-bec8be0c-de27-4e8b-8982-e7fb39aa0847" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-quobyte-bec8be0c-de27-4e8b-8982-e7fb39aa0847" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21855db1-7591-4f76-be3b-9e6e95ddf944]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:39 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-43738a3a-aed9-4f79-839c-f5964c1f83f9" returned: 0 in 0.526s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:39 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 Apr 02 10:34:39 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-quobyte-43738a3a-aed9-4f79-839c-f5964c1f83f9" released by "delete_volume" :: held 1.181s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Created reservations ['6bd62487-d3a1-482e-9104-9b3b365b6060', '0476ddc9-c343-4b21-97bf-318a100f0077', '4834e0ec-3fd5-4136-9120-cbc5dac078d0', '608558e7-4f7b-4f65-8c7f-9948b3216b0b'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:39 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:39 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:40 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847" returned: 0 in 0.538s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:40 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847 Apr 02 10:34:40 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Flow 'volume_create_manager' (2eeb3b6d-9ee0-4dfa-8ed8-d650bd1c8a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ceae785-5c55-4344-8c21-a6c5219a446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:40 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.470s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Deleted volume successfully. Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ceae785-5c55-4344-8c21-a6c5219a446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-935191780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993cba23-7248-4e31-8d63-cf61a9375243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce0f70b6ebd47449f71ac18fe0dae8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:40Z,use_quota=True,user_id='1ed6111796f14fe8b242ed2d1b01881d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1b29d5-314a-471e-869b-d0f8ec7ebb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1b29d5-314a-471e-869b-d0f8ec7ebb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13c3743-8014-4422-8f09-7840b769d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13c3743-8014-4422-8f09-7840b769d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993cba23-7248-4e31-8d63-cf61a9375243', 'volume_name': 'volume-993cba23-7248-4e31-8d63-cf61a9375243', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa5ae43-e814-41ff-be37-bb6bf8c3734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa5ae43-e814-41ff-be37-bb6bf8c3734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361b478f-57fc-4994-a082-320a4ace49a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:40 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Volume 993cba23-7248-4e31-8d63-cf61a9375243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993cba23-7248-4e31-8d63-cf61a9375243', 'volume_size': 1} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-935191780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993cba23-7248-4e31-8d63-cf61a9375243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce0f70b6ebd47449f71ac18fe0dae8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:40Z,use_quota=True,user_id='1ed6111796f14fe8b242ed2d1b01881d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Creating volume 993cba23-7248-4e31-8d63-cf61a9375243 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:40 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d4efba99-614e-4c84-a15d-93f8c0009caa tempest-VolumesSnapshotNegativeTestJSON-563133536 None] Lock "cinder-43738a3a-aed9-4f79-839c-f5964c1f83f9-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:40 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 1073741824 Apr 02 10:34:40 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:40 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-bec8be0c-de27-4e8b-8982-e7fb39aa0847" returned: 0 in 0.438s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-quobyte-bec8be0c-de27-4e8b-8982-e7fb39aa0847" released by "delete_volume" :: held 1.026s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Created reservations ['6397faa6-7af7-4d7f-9cc1-e4c65981e332', '51f58a73-6ab1-4d00-8701-0f1208d8d3b1', '0c57b245-a6cb-42c0-a716-aa352903d37b', 'b4554fa3-8df5-4139-974b-8fd17aa8521c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:40 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:40 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:41 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 1073741824" returned: 0 in 0.535s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:41 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 Apr 02 10:34:41 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:41 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.487s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Deleted volume successfully. Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4d80c0cd-ceee-438d-8492-af111dccc9f5 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-bec8be0c-de27-4e8b-8982-e7fb39aa0847-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:41 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243" returned: 0 in 0.474s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361b478f-57fc-4994-a082-320a4ace49a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993cba23-7248-4e31-8d63-cf61a9375243', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48c5df5-036e-45f7-bdb9-7dae7ea6dc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:41 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Volume volume-993cba23-7248-4e31-8d63-cf61a9375243 (993cba23-7248-4e31-8d63-cf61a9375243): created successfully Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48c5df5-036e-45f7-bdb9-7dae7ea6dc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Flow 'volume_create_manager' (2eeb3b6d-9ee0-4dfa-8ed8-d650bd1c8a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e7b71a06-fb40-40f7-9c96-85f0b17d13a9 tempest-AbsoluteLimitsTests-815185753 None] Created volume successfully. Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Flow 'volume_create_manager' (e771e495-d417-4f69-8785-e68a3dde6f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef201df-456d-40d2-ba04-cb87aea22a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef201df-456d-40d2-ba04-cb87aea22a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-140166287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1463ee19-dbe6-4d65-8780-b9692b1ef9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c1948cb7294bd993545b1edfa4f7c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:42Z,use_quota=True,user_id='d48ce3e7e378483d85f1305c0ec29872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae78c1ed-2765-4757-8b72-adac57c6cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae78c1ed-2765-4757-8b72-adac57c6cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b13940-7d64-41d1-9f1f-804cf5061553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b13940-7d64-41d1-9f1f-804cf5061553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1463ee19-dbe6-4d65-8780-b9692b1ef9b4', 'volume_name': 'volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfaf64c-841e-47cb-b891-b472620a3bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfaf64c-841e-47cb-b891-b472620a3bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08288a6b-3938-4d58-ae29-f7efb53b8809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Volume 1463ee19-dbe6-4d65-8780-b9692b1ef9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4', 'volume_size': 1} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-140166287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1463ee19-dbe6-4d65-8780-b9692b1ef9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c1948cb7294bd993545b1edfa4f7c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:42Z,use_quota=True,user_id='d48ce3e7e378483d85f1305c0ec29872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Creating volume 1463ee19-dbe6-4d65-8780-b9692b1ef9b4 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:42 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:42 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 1073741824 Apr 02 10:34:42 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Acquiring lock "cinder-993cba23-7248-4e31-8d63-cf61a9375243-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Lock "cinder-993cba23-7248-4e31-8d63-cf61a9375243-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Acquiring lock "cinder-quobyte-993cba23-7248-4e31-8d63-cf61a9375243" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Lock "cinder-quobyte-993cba23-7248-4e31-8d63-cf61a9375243" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e649dc-af73-4e42-b16f-63ba5dd99564]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:42 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 Apr 02 10:34:42 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (19a1acc5-e7a1-4557-8f7d-0711ca9a2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89ad190-a103-4ddd-9999-71c15881ed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89ad190-a103-4ddd-9999-71c15881ed54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622830347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98084cd-68cd-4e38-9671-f980d3d83959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:43Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174e8b2d-0dc4-472d-83d6-e91d49ced803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174e8b2d-0dc4-472d-83d6-e91d49ced803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff9fc35-f749-4b41-b642-da2257bfabc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff9fc35-f749-4b41-b642-da2257bfabc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98084cd-68cd-4e38-9671-f980d3d83959', 'volume_name': 'volume-b98084cd-68cd-4e38-9671-f980d3d83959', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a2b44-b76e-4069-826b-44c3327024fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a2b44-b76e-4069-826b-44c3327024fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef75d99-9eba-4436-905a-d05a86fbf4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:42 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume b98084cd-68cd-4e38-9671-f980d3d83959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98084cd-68cd-4e38-9671-f980d3d83959', 'volume_size': 1} Apr 02 10:34:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:43 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 1073741824" returned: 0 in 0.668s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:43 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 Apr 02 10:34:43 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:43 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243" returned: 0 in 0.597s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:43 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243 Apr 02 10:34:43 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:43 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4" returned: 0 in 0.443s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1622830347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98084cd-68cd-4e38-9671-f980d3d83959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:43Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating volume b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:43 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08288a6b-3938-4d58-ae29-f7efb53b8809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1486ff-00f3-49f7-a56d-7302a112b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:43 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 1073741824 Apr 02 10:34:43 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:43 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Volume volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 (1463ee19-dbe6-4d65-8780-b9692b1ef9b4): created successfully Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1486ff-00f3-49f7-a56d-7302a112b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Flow 'volume_create_manager' (e771e495-d417-4f69-8785-e68a3dde6f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-74baa200-e2e6-49e8-b276-b02a8e5732dd tempest-VolumesTransfersV357Test-1589605104 None] Created volume successfully. Apr 02 10:34:43 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-993cba23-7248-4e31-8d63-cf61a9375243" returned: 0 in 0.387s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Lock "cinder-quobyte-993cba23-7248-4e31-8d63-cf61a9375243" released by "delete_volume" :: held 1.014s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Created reservations ['b82aaa55-42bc-4d39-a855-4ffb41f700e6', '8092686e-7671-481c-8110-e68bb38b0f4c', '1ca22658-bfb1-4f2a-bef2-d1da0ffd89c4', '234aa2ec-b23d-4eee-b5aa-23497fb4b938'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:43 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:43 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:43 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 1073741824" returned: 0 in 0.487s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:44 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 Apr 02 10:34:44 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:44 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Deleted volume successfully. Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e56865c-0b8f-4b48-b075-799802ebd10e tempest-AbsoluteLimitsTests-815185753 None] Lock "cinder-993cba23-7248-4e31-8d63-cf61a9375243-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:44 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef75d99-9eba-4436-905a-d05a86fbf4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98084cd-68cd-4e38-9671-f980d3d83959', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50977e3c-01e7-421e-aa88-30a7dcbddce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:44 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume volume-b98084cd-68cd-4e38-9671-f980d3d83959 (b98084cd-68cd-4e38-9671-f980d3d83959): created successfully Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50977e3c-01e7-421e-aa88-30a7dcbddce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (19a1acc5-e7a1-4557-8f7d-0711ca9a2da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-11ea3784-9fef-4f8f-a581-b4e6bc971675 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created volume successfully. Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Acquiring lock "cinder-1463ee19-dbe6-4d65-8780-b9692b1ef9b4-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-1463ee19-dbe6-4d65-8780-b9692b1ef9b4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Acquiring lock "cinder-quobyte-1463ee19-dbe6-4d65-8780-b9692b1ef9b4" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-quobyte-1463ee19-dbe6-4d65-8780-b9692b1ef9b4" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16430e16-69cc-4c50-b5d8-36d2d21768a3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:44 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 Apr 02 10:34:44 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:45 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4" returned: 0 in 0.513s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:45 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4 Apr 02 10:34:45 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating offline snapshot 4244d907-9cda-4310-9e60-c71d5b5d66a6 of volume b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b14d5-0edd-4576-b2ea-23cbf9c5ad18]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:45 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 Apr 02 10:34:45 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:45 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1463ee19-dbe6-4d65-8780-b9692b1ef9b4" returned: 0 in 0.444s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-quobyte-1463ee19-dbe6-4d65-8780-b9692b1ef9b4" released by "delete_volume" :: held 0.981s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Created reservations ['1e0655b8-46bb-4a55-bc42-1a8210e36699', 'e944b531-a7cd-49a8-91bc-be66560f6e6d', '8d869636-941a-403a-8aea-3c9f3e979c8e', '03fb9e71-8b69-4559-9aab-882e69986f8c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:45 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:45 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:45 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959" returned: 0 in 0.579s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:45 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 1G Apr 02 10:34:45 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:46 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.470s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:46 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Deleted volume successfully. Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-61ce8cd7-22ea-4044-aa22-0656baaa17a7 tempest-VolumesTransfersV357Test-2117558117 None] Lock "cinder-1463ee19-dbe6-4d65-8780-b9692b1ef9b4-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:46 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:46 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:46 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 1G" returned: 0 in 0.549s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98084cd-68cd-4e38-9671-f980d3d83959 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:46 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98084cd-68cd-4e38-9671-f980d3d83959 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 Apr 02 10:34:46 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:46 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.505s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:46 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98084cd-68cd-4e38-9671-f980d3d83959 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6" returned: 0 in 0.527s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:46 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 is being set with open permissions: ugo+rw Apr 02 10:34:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:46 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 Apr 02 10:34:46 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:47 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6" returned: 0 in 0.447s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:47 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info Apr 02 10:34:47 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:47 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:47 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info is being set with open permissions: ugo+rw Apr 02 10:34:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:47 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info Apr 02 10:34:47 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Flow 'volume_create_manager' (f827b669-53cd-4efc-b9ac-44fd121070cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07a06fd-774d-4422-bbaa-51d23e29a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07a06fd-774d-4422-bbaa-51d23e29a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1521766340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faafeb0d-b64e-4ec4-9e81-a906ba5db41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef6ebaada4a4ffd9b068a516628e3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:48Z,use_quota=True,user_id='9ccdb6fa6e12414cbf1195e2dafccd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae8c89-a7eb-4f2d-8f87-0a157cc6a673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae8c89-a7eb-4f2d-8f87-0a157cc6a673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b805d2-2def-4fbb-930c-fdb4819e98ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b805d2-2def-4fbb-930c-fdb4819e98ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faafeb0d-b64e-4ec4-9e81-a906ba5db41d', 'volume_name': 'volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b2e0cd-750e-4144-b2db-0ea73772f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b2e0cd-750e-4144-b2db-0ea73772f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381898a9-61b3-45e0-b8c9-0b86377f2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:48 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Volume faafeb0d-b64e-4ec4-9e81-a906ba5db41d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d', 'volume_size': 1} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:48 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.info" returned: 0 in 0.511s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.167s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1521766340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faafeb0d-b64e-4ec4-9e81-a906ba5db41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef6ebaada4a4ffd9b068a516628e3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:48Z,use_quota=True,user_id='9ccdb6fa6e12414cbf1195e2dafccd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Creating volume faafeb0d-b64e-4ec4-9e81-a906ba5db41d {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:48 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:48 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d 1073741824 Apr 02 10:34:48 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a36b1820-8a74-4109-a3b2-309ee25fee29 tempest-CreateVolumesFromSnapshotTest-407070750 None] Create snapshot completed successfully Apr 02 10:34:48 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d 1073741824" returned: 0 in 0.533s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:48 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d Apr 02 10:34:48 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:49 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d" returned: 0 in 0.479s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381898a9-61b3-45e0-b8c9-0b86377f2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28adb411-5f2a-4af1-9627-8a3d7e287cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Volume volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d (faafeb0d-b64e-4ec4-9e81-a906ba5db41d): created successfully Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28adb411-5f2a-4af1-9627-8a3d7e287cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Flow 'volume_create_manager' (f827b669-53cd-4efc-b9ac-44fd121070cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:49 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7f431cdc-d1f7-47ce-8c77-839ca395e1d4 tempest-VolumesNegativeTest-1936951913 None] Created volume successfully. Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (3abe452d-aa61-4a82-a58a-698ab0dba8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a3b7c0-9005-45ee-ac79-5c47a612ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a3b7c0-9005-45ee-ac79-5c47a612ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084434879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101a7098-64e0-435e-941a-d790bfce6d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dcea18-129d-4ade-93c6-5fdc4242c672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dcea18-129d-4ade-93c6-5fdc4242c672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561578e3-4802-41ba-ac03-9a617f351a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561578e3-4802-41ba-ac03-9a617f351a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101a7098-64e0-435e-941a-d790bfce6d76', 'volume_name': 'volume-101a7098-64e0-435e-941a-d790bfce6d76', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc8d046-d578-4664-a2b1-135a444da469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc8d046-d578-4664-a2b1-135a444da469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf1b494-99b5-41e6-bd17-08c71609c4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume 101a7098-64e0-435e-941a-d790bfce6d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101a7098-64e0-435e-941a-d790bfce6d76', 'volume_size': 1} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084434879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101a7098-64e0-435e-941a-d790bfce6d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating volume 101a7098-64e0-435e-941a-d790bfce6d76 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:49 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:49 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 1073741824 Apr 02 10:34:49 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (6c685adf-43a1-4d96-88b4-bb79cbcc7b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab4f3a4-7a28-4225-b57b-d72540bbaa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab4f3a4-7a28-4225-b57b-d72540bbaa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554220110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51c824f-24cd-4421-a284-2ded76dd4377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e528c3e6-c717-4315-91cf-7b6366b8350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e528c3e6-c717-4315-91cf-7b6366b8350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e2bb55-3630-4dc2-9937-040b65ff2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e2bb55-3630-4dc2-9937-040b65ff2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51c824f-24cd-4421-a284-2ded76dd4377', 'volume_name': 'volume-f51c824f-24cd-4421-a284-2ded76dd4377', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff829bb3-d68b-45e8-8616-438eb0de9087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff829bb3-d68b-45e8-8616-438eb0de9087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b7cd29-4c69-4447-86ae-be6422a27bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume f51c824f-24cd-4421-a284-2ded76dd4377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51c824f-24cd-4421-a284-2ded76dd4377', 'volume_size': 1} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (0ff3e5a1-b06b-46ef-8d41-344c2e7217bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc07f14b-a4f5-4757-bdd8-1bdc0397a30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc07f14b-a4f5-4757-bdd8-1bdc0397a30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417878661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae3f334-1e96-48ac-ba1e-7b4e5669ef77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9d0809-609d-4907-96c4-e9f7ce009cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9d0809-609d-4907-96c4-e9f7ce009cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f590ca8-4bc2-4b03-86c1-4e9a667bfb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f590ca8-4bc2-4b03-86c1-4e9a667bfb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae3f334-1e96-48ac-ba1e-7b4e5669ef77', 'volume_name': 'volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc5e75-2e21-4b71-aa03-e1ef5236c978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc5e75-2e21-4b71-aa03-e1ef5236c978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12a01a4-7137-4294-a314-7a76da55a8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume 5ae3f334-1e96-48ac-ba1e-7b4e5669ef77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77', 'volume_size': 1} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:50 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 1073741824" returned: 0 in 0.685s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:50 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 Apr 02 10:34:50 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (994d6f3e-7bec-4e0f-8c1c-924ad8cb0556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5ce45c-22d2-4e38-82c4-7bec9ad6106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5ce45c-22d2-4e38-82c4-7bec9ad6106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-168225590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7dcef35-cefd-40b5-ba1c-efbfcbfa3593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623fc087-7600-49d5-8bcf-5be27d39fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623fc087-7600-49d5-8bcf-5be27d39fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7705551-cdaf-4533-9b74-de8a1ba5a753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7705551-cdaf-4533-9b74-de8a1ba5a753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7dcef35-cefd-40b5-ba1c-efbfcbfa3593', 'volume_name': 'volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948a0b0c-2dbf-4a0e-9e50-d248d1ced9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948a0b0c-2dbf-4a0e-9e50-d248d1ced9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5254ece9-8329-4e24-9cb8-68ed253105a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume f7dcef35-cefd-40b5-ba1c-efbfcbfa3593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593', 'volume_size': 1} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (79a45614-56ad-4833-b708-e525668f2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a26a9dc-cdc2-4b21-809f-7f86444255fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a26a9dc-cdc2-4b21-809f-7f86444255fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76235923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665b78e6-a516-4741-97d9-1b75f217cbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:51Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febb62d7-b52d-4daf-a1e8-4628d328c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febb62d7-b52d-4daf-a1e8-4628d328c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dc520b-c849-4f7e-93e7-b525fc570af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1dc520b-c849-4f7e-93e7-b525fc570af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665b78e6-a516-4741-97d9-1b75f217cbc7', 'volume_name': 'volume-665b78e6-a516-4741-97d9-1b75f217cbc7', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2ef9e1-e868-4d00-bbaf-cdee3746f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2ef9e1-e868-4d00-bbaf-cdee3746f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfba5956-c419-4524-bdb0-8e8ad0421ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume 665b78e6-a516-4741-97d9-1b75f217cbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665b78e6-a516-4741-97d9-1b75f217cbc7', 'volume_size': 1} Apr 02 10:34:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:51 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76" returned: 0 in 0.610s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554220110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51c824f-24cd-4421-a284-2ded76dd4377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating volume f51c824f-24cd-4421-a284-2ded76dd4377 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:51 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf1b494-99b5-41e6-bd17-08c71609c4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101a7098-64e0-435e-941a-d790bfce6d76', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:51 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 1073741824 Apr 02 10:34:51 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc10974d-a7a4-463f-bf97-20119172bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:51 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume volume-101a7098-64e0-435e-941a-d790bfce6d76 (101a7098-64e0-435e-941a-d790bfce6d76): created successfully Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc10974d-a7a4-463f-bf97-20119172bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (3abe452d-aa61-4a82-a58a-698ab0dba8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:51 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a3b72442-53af-4142-b758-822723c26cd7 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created volume successfully. Apr 02 10:34:51 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 1073741824" returned: 0 in 0.570s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:51 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 Apr 02 10:34:51 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:52 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377" returned: 0 in 0.443s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417878661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae3f334-1e96-48ac-ba1e-7b4e5669ef77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating volume 5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:52 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b7cd29-4c69-4447-86ae-be6422a27bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51c824f-24cd-4421-a284-2ded76dd4377', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59895e42-ed2b-400f-957d-f50b5f16f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:52 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 1073741824 Apr 02 10:34:52 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:52 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume volume-f51c824f-24cd-4421-a284-2ded76dd4377 (f51c824f-24cd-4421-a284-2ded76dd4377): created successfully Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59895e42-ed2b-400f-957d-f50b5f16f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (6c685adf-43a1-4d96-88b4-bb79cbcc7b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f9dc9a1c-235d-4655-a4ab-f3f256dc9b55 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created volume successfully. Apr 02 10:34:52 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 1073741824" returned: 0 in 0.546s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:52 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 Apr 02 10:34:52 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:53 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.530s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-168225590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7dcef35-cefd-40b5-ba1c-efbfcbfa3593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:50Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating volume f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:53 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12a01a4-7137-4294-a314-7a76da55a8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:53 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 1073741824 Apr 02 10:34:53 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59113487-ee9a-4e18-a432-f49ae5415fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:53 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 (5ae3f334-1e96-48ac-ba1e-7b4e5669ef77): created successfully Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59113487-ee9a-4e18-a432-f49ae5415fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (0ff3e5a1-b06b-46ef-8d41-344c2e7217bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-162070c5-f612-443b-88f9-0377e8138918 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created volume successfully. Apr 02 10:34:53 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 1073741824" returned: 0 in 0.550s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=253,cinder:SELECT=193,cinder:INSERT=68,cinder:DELETE=26 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:34:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:53 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 Apr 02 10:34:53 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:54 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.322s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76235923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665b78e6-a516-4741-97d9-1b75f217cbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41ee5d7f8584ace8aad865ee9abfb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:51Z,use_quota=True,user_id='2cb3cb468d6a463ca9af9d2702329667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Creating volume 665b78e6-a516-4741-97d9-1b75f217cbc7 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:54 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5254ece9-8329-4e24-9cb8-68ed253105a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2631000-52e2-492b-b06a-83e460c52ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:54 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 1073741824 Apr 02 10:34:54 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:54 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 (f7dcef35-cefd-40b5-ba1c-efbfcbfa3593): created successfully Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2631000-52e2-492b-b06a-83e460c52ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (994d6f3e-7bec-4e0f-8c1c-924ad8cb0556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-aedad9c1-b9da-4d15-b115-69dca40a3bc0 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created volume successfully. Apr 02 10:34:54 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 1073741824" returned: 0 in 0.595s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:54 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 Apr 02 10:34:54 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:55 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7" returned: 0 in 0.528s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfba5956-c419-4524-bdb0-8e8ad0421ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665b78e6-a516-4741-97d9-1b75f217cbc7', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bb04de-49ee-4bf2-a438-aba940f81151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:55 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Volume volume-665b78e6-a516-4741-97d9-1b75f217cbc7 (665b78e6-a516-4741-97d9-1b75f217cbc7): created successfully Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bb04de-49ee-4bf2-a438-aba940f81151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:55 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Flow 'volume_create_manager' (79a45614-56ad-4833-b708-e525668f2988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:55 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b8121be4-a6a4-43fc-9e0e-2cca7bc9e9de tempest-CreateVolumesFromSnapshotTest-407070750 None] Created volume successfully. Apr 02 10:34:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-665b78e6-a516-4741-97d9-1b75f217cbc7-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-665b78e6-a516-4741-97d9-1b75f217cbc7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-665b78e6-a516-4741-97d9-1b75f217cbc7" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-665b78e6-a516-4741-97d9-1b75f217cbc7" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[063fc0ff-02d2-4da2-af60-f2acf7238546]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:56 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 Apr 02 10:34:56 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Flow 'volume_create_manager' (9d63ecd5-af98-4daa-acf2-4d523e29c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb46385-84ac-4803-9a23-ac807f50da8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb46385-84ac-4803-9a23-ac807f50da8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985195855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ce6fc2-652b-4eb5-b350-6b43435d561c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62abfdc5c770487588c5d2ce57216ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:57Z,use_quota=True,user_id='02bb5c3aad8f489dad5712abfb2152ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09385278-eead-445d-aaf1-8bf5f76819f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09385278-eead-445d-aaf1-8bf5f76819f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa5a56f-ecb6-43c7-9122-44c584c436f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa5a56f-ecb6-43c7-9122-44c584c436f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ce6fc2-652b-4eb5-b350-6b43435d561c', 'volume_name': 'volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb62fb04-4c64-4517-b85d-e98245c3a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb62fb04-4c64-4517-b85d-e98245c3a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deae419-1b6e-4e34-9a58-f876a93f3d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:57 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Volume f4ce6fc2-652b-4eb5-b350-6b43435d561c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c', 'volume_size': 1} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985195855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ce6fc2-652b-4eb5-b350-6b43435d561c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62abfdc5c770487588c5d2ce57216ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:57Z,use_quota=True,user_id='02bb5c3aad8f489dad5712abfb2152ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Creating volume f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:34:57 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:57 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c 1073741824 Apr 02 10:34:57 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:57 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7" returned: 0 in 0.791s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:57 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7 Apr 02 10:34:57 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:57 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c 1073741824" returned: 0 in 0.571s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:57 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-665b78e6-a516-4741-97d9-1b75f217cbc7" returned: 0 in 0.522s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-665b78e6-a516-4741-97d9-1b75f217cbc7" released by "delete_volume" :: held 1.359s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:58 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:34:58 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['428dda5d-599d-490c-a52e-9604003a2176', '9db8d3d3-470a-4a6f-8a46-c1b2c4c3b6c2', 'ba84c9fa-aada-4d81-9250-33196d6f31fb', 'bff56837-668b-4b35-ac76-7ff4bd0a8671'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:58 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:58 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:58 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.435s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deae419-1b6e-4e34-9a58-f876a93f3d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70be250a-a5ad-48fa-9f9e-95a779f3c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:34:58 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Volume volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c (f4ce6fc2-652b-4eb5-b350-6b43435d561c): created successfully Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70be250a-a5ad-48fa-9f9e-95a779f3c9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Flow 'volume_create_manager' (9d63ecd5-af98-4daa-acf2-4d523e29c111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:34:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0de21b8a-aa01-4045-ad49-7b7451f467b1 tempest-VolumesActionsTest-608298695 None] Created volume successfully. Apr 02 10:34:58 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.448s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:34:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleted volume successfully. Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-05fc05f7-689e-4dce-b21a-46465a295689 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-665b78e6-a516-4741-97d9-1b75f217cbc7-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[feca5611-24d3-4eda-a4b8-8b71815738a8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:58 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 Apr 02 10:34:58 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:59 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593" returned: 0 in 0.478s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:59 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593 Apr 02 10:34:59 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:59 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593" returned: 0 in 0.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593" released by "delete_volume" :: held 0.908s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['1c6e12a1-b365-451a-b90f-758125fb1878', '81a85409-3ec1-4448-b816-2e7aad60208d', '22829fc9-57c5-42b1-a14a-437392f42aa6', '81945f7a-69d3-4973-b5a9-32a9e2b8f4d5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:59 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:34:59 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc76dd89-aa0e-4012-b081-536ff5120fec]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:34:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:34:59 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 Apr 02 10:34:59 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:00 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.579s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleted volume successfully. Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5c59fac1-46d8-4060-9844-de845dabf59f tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-f7dcef35-cefd-40b5-ba1c-efbfcbfa3593-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77" returned: 0 in 0.542s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:00 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:00 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77 Apr 02 10:35:00 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:00 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77" released by "delete_volume" :: held 0.997s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['9f60d679-7f6b-42f1-bfe0-871481581d8b', 'ffea7a73-634d-474c-be49-7c88e2ea9ec0', '8b1bbdcd-2fd2-48fd-9c35-d58960d5ea67', '54f6c09f-8d1b-443d-a481-50e8c7edf697'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:00 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:00 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-f51c824f-24cd-4421-a284-2ded76dd4377-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-f51c824f-24cd-4421-a284-2ded76dd4377-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-f51c824f-24cd-4421-a284-2ded76dd4377" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-f51c824f-24cd-4421-a284-2ded76dd4377" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd1360-bfe9-4ad0-a906-88a385c6913a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:01 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 Apr 02 10:35:01 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:01 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.427s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:01 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleted volume successfully. Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-428a98b9-b276-4aff-9fe6-c08eff428a9e tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-5ae3f334-1e96-48ac-ba1e-7b4e5669ef77-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:01 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377" returned: 0 in 0.539s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:01 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377 Apr 02 10:35:01 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:02 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f51c824f-24cd-4421-a284-2ded76dd4377" returned: 0 in 0.449s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-f51c824f-24cd-4421-a284-2ded76dd4377" released by "delete_volume" :: held 1.015s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['9b0d5438-43ea-4b64-881b-1a1834b2687d', '60e6a4c4-83c6-4e57-8e08-b391f0779ce1', 'd4205a57-0a1e-4a48-838d-71244575b6d1', '68ab3592-d59d-4a72-a394-ed954e5f3abe'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:02 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:02 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:02 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.735s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:02 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleted volume successfully. Apr 02 10:35:02 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-83862d61-87b6-49aa-ac87-51f04c9d5ea3 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-f51c824f-24cd-4421-a284-2ded76dd4377-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-101a7098-64e0-435e-941a-d790bfce6d76-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-101a7098-64e0-435e-941a-d790bfce6d76-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-101a7098-64e0-435e-941a-d790bfce6d76" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-101a7098-64e0-435e-941a-d790bfce6d76" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7fbb77-f18a-4937-9b11-fd5ee5e17feb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:03 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 Apr 02 10:35:03 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:03 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76" returned: 0 in 0.495s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:03 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76 Apr 02 10:35:03 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:04 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-101a7098-64e0-435e-941a-d790bfce6d76" returned: 0 in 0.420s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-101a7098-64e0-435e-941a-d790bfce6d76" released by "delete_volume" :: held 0.960s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['5b9cb11a-2b5d-4add-8778-fccda0da0c81', '9b194aa1-c74c-4bd9-96e0-1903d0784714', '5c6c4da9-744c-47a6-8819-6e09271bef38', 'd178bb46-927e-458d-ac7a-1dfbc8a4dabd'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:04 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:04 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-4244d907-9cda-4310-9e60-c71d5b5d66a6-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-4244d907-9cda-4310-9e60-c71d5b5d66a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-b98084cd-68cd-4e38-9671-f980d3d83959" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-b98084cd-68cd-4e38-9671-f980d3d83959" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-4244d907-9cda-4310-9e60-c71d5b5d66a6" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-4244d907-9cda-4310-9e60-c71d5b5d66a6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleting offline snapshot 4244d907-9cda-4310-9e60-c71d5b5d66a6 of volume b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] snapshot_file for this snap is: volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe07eaf-3543-4fcb-a719-444301df6abe]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:04 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 Apr 02 10:35:04 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:05 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.776s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:05 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleted volume successfully. Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e053515c-d428-426f-8447-fb50420eafb6 tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-101a7098-64e0-435e-941a-d790bfce6d76-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:05 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6" returned: 0 in 0.680s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98084cd-68cd-4e38-9671-f980d3d83959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10053673-5fe9-4d8a-9353-7e8b4a7b5c70]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:05 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 Apr 02 10:35:05 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:05 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959" returned: 0 in 0.592s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:05 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 Apr 02 10:35:05 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:06 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6" returned: 0 in 0.540s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:06 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6 Apr 02 10:35:06 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:06 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959.4244d907-9cda-4310-9e60-c71d5b5d66a6" returned: 0 in 0.472s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-4244d907-9cda-4310-9e60-c71d5b5d66a6" released by "_delete_snapshot" :: held 2.385s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-b98084cd-68cd-4e38-9671-f980d3d83959" released by "delete_snapshot" :: held 2.406s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['00120e65-bf80-4621-bff6-d6d601202f94', '49f96f7c-a989-425a-bcf7-116dbd8f6243', '3e53c6ba-fb6d-4783-b234-ff321212db23', '1a4349a2-c380-438c-8797-25d526264303'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Delete snapshot completed successfully. Apr 02 10:35:06 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a3c73818-ef20-4871-9763-48cd71bc276b tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-4244d907-9cda-4310-9e60-c71d5b5d66a6-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-b98084cd-68cd-4e38-9671-f980d3d83959-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-b98084cd-68cd-4e38-9671-f980d3d83959-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "cinder-quobyte-b98084cd-68cd-4e38-9671-f980d3d83959" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-b98084cd-68cd-4e38-9671-f980d3d83959" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:07 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b74eba-b61e-4a45-9cb1-0bf229c6583d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:07 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 Apr 02 10:35:07 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:08 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959" returned: 0 in 0.455s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:08 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959 Apr 02 10:35:08 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:08 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b98084cd-68cd-4e38-9671-f980d3d83959" returned: 0 in 0.411s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-quobyte-b98084cd-68cd-4e38-9671-f980d3d83959" released by "delete_volume" :: held 0.912s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Created reservations ['ce601540-a47c-4b4e-ba15-cdc616ac6de6', '64988299-20a5-4833-8149-dbcf973c3790', 'ffa3bdb3-f6cc-4fe7-8e17-73272f312adc', 'c4432413-b86f-46ef-957e-df968e16e59a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:08 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:08 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:09 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:09 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:09 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Deleted volume successfully. Apr 02 10:35:09 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-6a96ee96-09c9-4e70-a3f1-8ee2ac15c92c tempest-CreateVolumesFromSnapshotTest-407070750 None] Lock "cinder-b98084cd-68cd-4e38-9671-f980d3d83959-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (ffd648a6-1b1a-42a6-840f-ba247ff647dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a01031-a0ff-44d5-8444-b44276460e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a01031-a0ff-44d5-8444-b44276460e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733612787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f9da25-6be9-4ca0-9983-871e38b5dcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:10Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166e9f2c-98f9-449a-8185-13b9c6030eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166e9f2c-98f9-449a-8185-13b9c6030eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6967bf-9b02-4441-83fb-9aad6b606430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6967bf-9b02-4441-83fb-9aad6b606430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f9da25-6be9-4ca0-9983-871e38b5dcf5', 'volume_name': 'volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100bad89-4824-4a28-a5c6-4351bbd27df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100bad89-4824-4a28-a5c6-4351bbd27df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672254b-a467-4ac0-80b9-1e445af7747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:10 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume 96f9da25-6be9-4ca0-9983-871e38b5dcf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5', 'volume_size': 1} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733612787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f9da25-6be9-4ca0-9983-871e38b5dcf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:10Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Creating volume 96f9da25-6be9-4ca0-9983-871e38b5dcf5 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:35:10 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:35:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:10 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 1073741824 Apr 02 10:35:10 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:11 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 1073741824" returned: 0 in 0.543s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:11 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 Apr 02 10:35:11 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:11 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5" returned: 0 in 0.801s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672254b-a467-4ac0-80b9-1e445af7747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22771a0-63e1-4940-ba19-857c9f9bad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:11 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 (96f9da25-6be9-4ca0-9983-871e38b5dcf5): created successfully Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22771a0-63e1-4940-ba19-857c9f9bad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (ffd648a6-1b1a-42a6-840f-ba247ff647dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:12 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5504e364-887d-4b94-8b6b-c22b16950af1 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created volume successfully. Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (5f396bde-efaa-4263-8064-1e72ba10e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1305618e-3f2f-458d-b0df-a1375f9f2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1305618e-3f2f-458d-b0df-a1375f9f2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927546896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e9bced-7fff-417b-a6ee-3a205471cacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:13Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf767ecf-a42d-426c-9b2a-b8530b8bd204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf767ecf-a42d-426c-9b2a-b8530b8bd204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73694b03-b1f4-4b80-af8f-4ac95259419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73694b03-b1f4-4b80-af8f-4ac95259419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e9bced-7fff-417b-a6ee-3a205471cacc', 'volume_name': 'volume-85e9bced-7fff-417b-a6ee-3a205471cacc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbb410f-097e-451f-86b3-6c427a39692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbb410f-097e-451f-86b3-6c427a39692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb169c1c-4754-4493-8bc0-89f39ac7f94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume 85e9bced-7fff-417b-a6ee-3a205471cacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e9bced-7fff-417b-a6ee-3a205471cacc', 'volume_size': 1} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927546896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e9bced-7fff-417b-a6ee-3a205471cacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:13Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Creating volume 85e9bced-7fff-417b-a6ee-3a205471cacc {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:35:13 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:13 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc 1073741824 Apr 02 10:35:13 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (99e97814-6af5-40ac-ba7f-266571ce0767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93037901-b4ba-400c-a29e-98f9715f0492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93037901-b4ba-400c-a29e-98f9715f0492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516898475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d8db8f-e8da-4250-8978-8211f52c4cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:13Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f09beca-8670-431e-95d9-dee5be56885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f09beca-8670-431e-95d9-dee5be56885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc00dc04-cb95-4930-81e8-3bcba1aba786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc00dc04-cb95-4930-81e8-3bcba1aba786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d8db8f-e8da-4250-8978-8211f52c4cf5', 'volume_name': 'volume-18d8db8f-e8da-4250-8978-8211f52c4cf5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c995f6-0fb8-4c3e-9907-b59aff57dc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c995f6-0fb8-4c3e-9907-b59aff57dc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3f563d-e436-4efb-a089-95ed4b554c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume 18d8db8f-e8da-4250-8978-8211f52c4cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d8db8f-e8da-4250-8978-8211f52c4cf5', 'volume_size': 1} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=281,cinder:DELETE=20,cinder:SELECT=176,cinder:INSERT=61 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (5c4cead9-5a30-4ef4-a752-38616db1e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e2a898-97f8-41ed-a8ce-b08e109cbdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e2a898-97f8-41ed-a8ce-b08e109cbdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2126724304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfc5c36-2fa9-49af-bd29-f55d726bd3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:14Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b48ffbc-1afc-443b-8832-f8f1feebb510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b48ffbc-1afc-443b-8832-f8f1feebb510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8443f259-f3c4-43ec-b678-ca7f730ae2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8443f259-f3c4-43ec-b678-ca7f730ae2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfc5c36-2fa9-49af-bd29-f55d726bd3ce', 'volume_name': 'volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312bdf05-f216-4de4-8fe7-5c6a72864fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312bdf05-f216-4de4-8fe7-5c6a72864fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7927f8a4-897f-4f88-b093-a1dcab85fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume 1bfc5c36-2fa9-49af-bd29-f55d726bd3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce', 'volume_size': 1} Apr 02 10:35:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:35:14 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (65998b21-11df-49a8-b429-e86b83925443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a65dff-674b-4c1b-9c17-fe4c42563de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc 1073741824" returned: 0 in 0.930s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a65dff-674b-4c1b-9c17-fe4c42563de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609397265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:14Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1323f92f-293e-47c6-8729-409c2e712746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1323f92f-293e-47c6-8729-409c2e712746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9aa62a-f175-4230-ad3a-b59c79b130bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9aa62a-f175-4230-ad3a-b59c79b130bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6', 'volume_name': 'volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f34d959-acf3-4e6b-87ea-94eaa001f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f34d959-acf3-4e6b-87ea-94eaa001f5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a80aea-50f2-4260-9d52-db8bb22811d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6', 'volume_size': 1} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:14 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc Apr 02 10:35:14 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (d0f012e6-8eb3-4c8c-a0e0-391b19baedfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f0e08f-ef11-4bde-8173-7333938ca68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f0e08f-ef11-4bde-8173-7333938ca68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022602262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a915d5c-4ebb-4b18-9e51-034d76b73aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:14Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ed7113-0306-4252-8530-dec2dd579db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ed7113-0306-4252-8530-dec2dd579db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c538e0-9130-4019-b8ee-d8524cd4ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c538e0-9130-4019-b8ee-d8524cd4ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a915d5c-4ebb-4b18-9e51-034d76b73aef', 'volume_name': 'volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39b624c-3dcc-4143-a2d6-41a6448aee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39b624c-3dcc-4143-a2d6-41a6448aee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3213877a-e0d0-44b6-91aa-aea0f49690a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume 4a915d5c-4ebb-4b18-9e51-034d76b73aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef', 'volume_size': 1} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:14 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc" returned: 0 in 0.546s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516898475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d8db8f-e8da-4250-8978-8211f52c4cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:13Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Creating volume 18d8db8f-e8da-4250-8978-8211f52c4cf5 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:35:14 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb169c1c-4754-4493-8bc0-89f39ac7f94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e9bced-7fff-417b-a6ee-3a205471cacc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 1073741824 Apr 02 10:35:14 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493e96e2-a983-482a-bae3-ec37bcb7e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume volume-85e9bced-7fff-417b-a6ee-3a205471cacc (85e9bced-7fff-417b-a6ee-3a205471cacc): created successfully Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493e96e2-a983-482a-bae3-ec37bcb7e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (5f396bde-efaa-4263-8064-1e72ba10e077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c8865e9d-679c-4a50-8b1a-5f6bdd6aefd3 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created volume successfully. Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-410201cf-9e2b-4f35-84c3-49faac669d4c tempest-VolumesActionsTest-608298695 None] Acquiring lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c" by "attach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-410201cf-9e2b-4f35-84c3-49faac669d4c tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c" acquired by "attach_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-410201cf-9e2b-4f35-84c3-49faac669d4c tempest-VolumesActionsTest-608298695 None] Attaching volume f4ce6fc2-652b-4eb5-b350-6b43435d561c to instance 856c3a89-6d46-40f2-a1fc-61d77a00f2fb at mountpoint /dev/vdb on host None. Apr 02 10:35:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-410201cf-9e2b-4f35-84c3-49faac669d4c tempest-VolumesActionsTest-608298695 None] Attach volume completed successfully. Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-410201cf-9e2b-4f35-84c3-49faac669d4c tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c" released by "attach_volume" :: held 0.067s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:15 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 1073741824" returned: 0 in 0.683s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:15 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 Apr 02 10:35:15 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e439860-07db-437b-92cd-b620c64740c7 tempest-VolumesActionsTest-608298695 None] Acquiring lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-detach_volume" by "detach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e439860-07db-437b-92cd-b620c64740c7 tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5e439860-07db-437b-92cd-b620c64740c7 tempest-VolumesActionsTest-608298695 None] Detaching volume f4ce6fc2-652b-4eb5-b350-6b43435d561c from instance 856c3a89-6d46-40f2-a1fc-61d77a00f2fb. Apr 02 10:35:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5e439860-07db-437b-92cd-b620c64740c7 tempest-VolumesActionsTest-608298695 None] Detach volume completed successfully. Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5e439860-07db-437b-92cd-b620c64740c7 tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:15 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5" returned: 0 in 0.545s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2126724304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfc5c36-2fa9-49af-bd29-f55d726bd3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:14Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Creating volume 1bfc5c36-2fa9-49af-bd29-f55d726bd3ce {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:35:15 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3f563d-e436-4efb-a089-95ed4b554c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d8db8f-e8da-4250-8978-8211f52c4cf5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:15 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce 1073741824 Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba75dc7a-b338-4da3-9a0f-0a1d8b13db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:15 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:15 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 (18d8db8f-e8da-4250-8978-8211f52c4cf5): created successfully Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba75dc7a-b338-4da3-9a0f-0a1d8b13db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (99e97814-6af5-40ac-ba7f-266571ce0767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-826ca2ac-35b5-470e-bb5b-bc661ecfd3e8 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created volume successfully. Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Acquiring lock "cinder-faafeb0d-b64e-4ec4-9e81-a906ba5db41d-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Lock "cinder-faafeb0d-b64e-4ec4-9e81-a906ba5db41d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Acquiring lock "cinder-quobyte-faafeb0d-b64e-4ec4-9e81-a906ba5db41d" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Lock "cinder-quobyte-faafeb0d-b64e-4ec4-9e81-a906ba5db41d" acquired by "delete_volume" :: waited 0.018s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6d7370-cd31-494c-b029-e5b8b529b56d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:16 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d Apr 02 10:35:16 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:16 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce 1073741824" returned: 0 in 0.617s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:16 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce Apr 02 10:35:16 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:16 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d" returned: 0 in 0.542s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:16 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d Apr 02 10:35:16 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:17 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce" returned: 0 in 0.458s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.944s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609397265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:14Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Creating volume eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:35:17 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7927f8a4-897f-4f88-b093-a1dcab85fa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ed35a1-3c70-4b65-9d67-4632ebce4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:17 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 1073741824 Apr 02 10:35:17 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:17 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-faafeb0d-b64e-4ec4-9e81-a906ba5db41d" returned: 0 in 0.422s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce (1bfc5c36-2fa9-49af-bd29-f55d726bd3ce): created successfully Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ed35a1-3c70-4b65-9d67-4632ebce4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (5c4cead9-5a30-4ef4-a752-38616db1e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Lock "cinder-quobyte-faafeb0d-b64e-4ec4-9e81-a906ba5db41d" released by "delete_volume" :: held 1.032s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-091afa47-5a37-4321-a267-3f1d5c8358fd tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created volume successfully. Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Created reservations ['767f9e2a-f41d-4db7-9fe4-6ae1926b91a5', 'f73faefd-7e56-453a-98bf-1dbe5debf9b3', 'cd8fcc2c-452d-4c99-87b3-c1e8f6de3481', '466a8e9d-df54-4880-89ff-7ccfe5dd958d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:17 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:17 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:17 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 1073741824" returned: 0 in 0.693s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:17 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 Apr 02 10:35:17 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:17 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.614s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Deleted volume successfully. Apr 02 10:35:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b5e66db-d737-49fa-8b4d-491af1b16af8 tempest-VolumesNegativeTest-1936951913 None] Lock "cinder-faafeb0d-b64e-4ec4-9e81-a906ba5db41d-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:18 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6" returned: 0 in 0.474s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.884s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022602262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a915d5c-4ebb-4b18-9e51-034d76b73aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e724f07b3bcb44ce87f2f35c5b1759f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:14Z,use_quota=True,user_id='4219462f61874f708e43bdf93490f39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Creating volume 4a915d5c-4ebb-4b18-9e51-034d76b73aef {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:35:18 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a80aea-50f2-4260-9d52-db8bb22811d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cd0400-121a-4ac5-b61a-3a813625d91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:18 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef 1073741824 Apr 02 10:35:18 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:18 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 (eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6): created successfully Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cd0400-121a-4ac5-b61a-3a813625d91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (65998b21-11df-49a8-b429-e86b83925443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-cde0f2b6-5126-4896-bdbf-1c79ca46e812 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created volume successfully. Apr 02 10:35:18 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef 1073741824" returned: 0 in 0.606s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:18 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef Apr 02 10:35:18 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:19 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef" returned: 0 in 0.487s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3213877a-e0d0-44b6-91aa-aea0f49690a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4cb525-4a88-4bf7-af14-c785d2847fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:35:19 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Volume volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef (4a915d5c-4ebb-4b18-9e51-034d76b73aef): created successfully Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4cb525-4a88-4bf7-af14-c785d2847fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Flow 'volume_create_manager' (d0f012e6-8eb3-4c8c-a0e0-391b19baedfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:35:19 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7fa78e0c-02ad-49fd-826b-ecead10f7707 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created volume successfully. Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-4a915d5c-4ebb-4b18-9e51-034d76b73aef-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-4a915d5c-4ebb-4b18-9e51-034d76b73aef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-quobyte-4a915d5c-4ebb-4b18-9e51-034d76b73aef" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-4a915d5c-4ebb-4b18-9e51-034d76b73aef" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a2c15a-dcea-4e28-937a-ea5847a0c81d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:20 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef Apr 02 10:35:20 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:20 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef" returned: 0 in 0.504s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:20 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef Apr 02 10:35:20 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:20 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4a915d5c-4ebb-4b18-9e51-034d76b73aef" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-4a915d5c-4ebb-4b18-9e51-034d76b73aef" released by "delete_volume" :: held 0.964s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:20 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created reservations ['53cec830-edcf-4179-9508-ce796f6ff63b', 'c065a122-5315-487d-ba7a-9f05fd079ed1', 'b3817838-776c-452d-a11c-e0b863320b96', 'bcef1100-44d5-42b9-9ccd-333a2321c19a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:21 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:21 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-quobyte-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af45a26-78d7-4183-817a-88e66d42d1f7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:21 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 Apr 02 10:35:21 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:21 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Deleted volume successfully. Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d6f328f3-27c5-4317-94c1-8b107efed4b6 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-4a915d5c-4ebb-4b18-9e51-034d76b73aef-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:21 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6" returned: 0 in 0.511s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:21 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6 Apr 02 10:35:21 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:22 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6" returned: 0 in 0.403s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6" released by "delete_volume" :: held 0.951s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created reservations ['713210cd-88f8-48b4-af5f-2667c91d8c04', '35c73786-b06b-49b7-bcea-c763debfb8de', 'e8f11c5b-f215-4855-87bc-f28a9b110ed5', 'a8d87131-2541-4d31-8b9a-40c08a35cce2'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:22 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:22 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-quobyte-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4d4415-a680-4cf2-b5f7-bbdc0d1f0d16]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:22 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce Apr 02 10:35:22 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:22 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.454s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Deleted volume successfully. Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f000a00b-93a5-4733-bfcc-7bda7b77d064 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-eb0bdc88-f050-4b65-957b-f9ec3fe2e5e6-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:22 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce" returned: 0 in 0.503s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:22 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce Apr 02 10:35:22 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:23 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce" returned: 0 in 0.410s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce" released by "delete_volume" :: held 0.935s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created reservations ['e2e6883f-7aff-47ac-b827-1c3a1bd30edb', '429bb757-831f-438e-923f-4dc576dcbcac', 'fd29c49e-5b71-4a80-912c-3cd07f8573db', 'e8715414-79d4-4025-acc6-47e0ee13f32c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:23 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:23 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-18d8db8f-e8da-4250-8978-8211f52c4cf5-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-18d8db8f-e8da-4250-8978-8211f52c4cf5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-quobyte-18d8db8f-e8da-4250-8978-8211f52c4cf5" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-18d8db8f-e8da-4250-8978-8211f52c4cf5" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806b114-c3f8-4b26-a04c-a4e3818cd544]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:23 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 Apr 02 10:35:23 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:23 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.499s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Deleted volume successfully. Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50959ef0-2a8b-4171-98ce-d265a176ef72 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-1bfc5c36-2fa9-49af-bd29-f55d726bd3ce-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:23 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5" returned: 0 in 0.539s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:23 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5 Apr 02 10:35:23 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:24 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-18d8db8f-e8da-4250-8978-8211f52c4cf5" returned: 0 in 0.466s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-18d8db8f-e8da-4250-8978-8211f52c4cf5" released by "delete_volume" :: held 1.028s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created reservations ['939e83ba-cf38-4594-a6c3-fd890db09c74', '2963473e-7509-42f7-a22f-f3240de0af11', '518b9ec5-7ef5-4c59-9ee7-b08e852d8543', '3bdfe6c4-caec-46e0-8b23-54a427496dca'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:24 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:24 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:24 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.414s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Deleted volume successfully. Apr 02 10:35:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b79710dd-725e-4d83-bffb-7bf667c4e0b2 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-18d8db8f-e8da-4250-8978-8211f52c4cf5-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-85e9bced-7fff-417b-a6ee-3a205471cacc-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-85e9bced-7fff-417b-a6ee-3a205471cacc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-quobyte-85e9bced-7fff-417b-a6ee-3a205471cacc" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-85e9bced-7fff-417b-a6ee-3a205471cacc" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da34f00-df11-4fab-878d-f9f628029c9c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:25 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc Apr 02 10:35:25 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:26 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc" returned: 0 in 0.472s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:26 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc Apr 02 10:35:26 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:26 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-85e9bced-7fff-417b-a6ee-3a205471cacc" returned: 0 in 0.393s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-85e9bced-7fff-417b-a6ee-3a205471cacc" released by "delete_volume" :: held 0.887s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created reservations ['f2c6b66c-4e01-4672-b9d8-6fc4bfb0834f', '07c092f2-833f-464f-9a9e-8e87dbc095de', '9c44ea86-b76e-47bb-b372-61f16692b553', 'ac79f9e0-41eb-4ab4-8172-7587411a8e4a'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:26 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:26 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-96f9da25-6be9-4ca0-9983-871e38b5dcf5-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-96f9da25-6be9-4ca0-9983-871e38b5dcf5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "cinder-quobyte-96f9da25-6be9-4ca0-9983-871e38b5dcf5" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-96f9da25-6be9-4ca0-9983-871e38b5dcf5" acquired by "delete_volume" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[054715bd-c135-421f-a35d-8013cc0334ff]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:26 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 Apr 02 10:35:26 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:26 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.427s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Deleted volume successfully. Apr 02 10:35:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9356cecb-fbd7-4ae7-a6a2-cfd41b921005 tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-85e9bced-7fff-417b-a6ee-3a205471cacc-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:27 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5" returned: 0 in 0.494s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:27 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5 Apr 02 10:35:27 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:27 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-96f9da25-6be9-4ca0-9983-871e38b5dcf5" returned: 0 in 0.415s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-quobyte-96f9da25-6be9-4ca0-9983-871e38b5dcf5" released by "delete_volume" :: held 0.937s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Created reservations ['1d6fa44c-4dc7-4651-a259-205a91675537', '7ed67bdf-29c5-4290-a89e-a98b36c3eeba', '94065ea1-173d-4d92-aba3-d7c1afe0bf41', 'df97f988-be7f-48cc-b933-c37c963ef383'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:27 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:27 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:28 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:28 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:28 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Deleted volume successfully. Apr 02 10:35:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-50d693fa-91f0-461e-a4f6-9370f95ce84a tempest-CreateVolumesFromSourceVolumeTest-429009744 None] Lock "cinder-96f9da25-6be9-4ca0-9983-871e38b5dcf5-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f8a825c-0827-4912-bed7-c4ec4cb4389e tempest-VolumesActionsTest-608298695 None] Acquiring lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c" by "attach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f8a825c-0827-4912-bed7-c4ec4cb4389e tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c" acquired by "attach_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5f8a825c-0827-4912-bed7-c4ec4cb4389e tempest-VolumesActionsTest-608298695 None] Attaching volume f4ce6fc2-652b-4eb5-b350-6b43435d561c to instance ad641a2d-8e3d-4953-9260-6f6b0d648bd8 at mountpoint /dev/vdb on host None. Apr 02 10:35:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5f8a825c-0827-4912-bed7-c4ec4cb4389e tempest-VolumesActionsTest-608298695 None] Attach volume completed successfully. Apr 02 10:35:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f8a825c-0827-4912-bed7-c4ec4cb4389e tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c" released by "attach_volume" :: held 0.055s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-876fc4c9-301b-4ea5-987d-c8fa4df871ff tempest-VolumesActionsTest-608298695 None] Acquiring lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-detach_volume" by "detach_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:35:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-876fc4c9-301b-4ea5-987d-c8fa4df871ff tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:35:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-876fc4c9-301b-4ea5-987d-c8fa4df871ff tempest-VolumesActionsTest-608298695 None] Detaching volume f4ce6fc2-652b-4eb5-b350-6b43435d561c from instance ad641a2d-8e3d-4953-9260-6f6b0d648bd8. Apr 02 10:35:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-876fc4c9-301b-4ea5-987d-c8fa4df871ff tempest-VolumesActionsTest-608298695 None] Detach volume completed successfully. Apr 02 10:35:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-876fc4c9-301b-4ea5-987d-c8fa4df871ff tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:35:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:45 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da062407-810f-4be4-b09a-07d715366536]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:45 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:35:45 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:46 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.517s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64149a-44e5-4311-b9c8-19b5c6deeb93]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:46 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:35:46 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:46 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:35:46 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:46 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.497s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.ac759aa7-061b-4741-84f9-45e00385e8cb_gmcq0id.img {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:46 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.ac759aa7-061b-4741-84f9-45e00385e8cb_gmcq0id.img Apr 02 10:35:46 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:46 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.425s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:35:47 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=79,cinder:INSERT=16,cinder:SELECT=53,cinder:DELETE=5 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:35:48 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.ac759aa7-061b-4741-84f9-45e00385e8cb_gmcq0id.img" returned: 0 in 1.841s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:48 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a4adf-9718-46e9-a4a6-b1166d0b8ba7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:35:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:35:48 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:35:48 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:35:49 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 02 10:35:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.634s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:35:49 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.ac759aa7-061b-4741-84f9-45e00385e8cb_gmcq0id.img {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:35:49 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Converted 1024.00 MB image at 555.87 MB/s Apr 02 10:35:49 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] ac759aa7-061b-4741-84f9-45e00385e8cb was raw, no need to convert to raw {{(pid=82391) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 02 10:35:55 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=127,cinder:SELECT=97,cinder:INSERT=32,cinder:DELETE=12 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:35:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.550s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:35:59 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Uploaded volume to glance image-id: ac759aa7-061b-4741-84f9-45e00385e8cb. {{(pid=82391) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 02 10:35:59 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=2 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:35:59 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-01d913b8-8952-4c7e-ba67-2af1df9561e6 tempest-VolumesActionsTest-608298695 None] Copy volume to image completed successfully. Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06baa943-192a-4313-858d-18d5abcdca10]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:00 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:36:00 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:00 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.471s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[328d8998-4ada-48a4-ad28-c407f29e5640]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:01 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:36:01 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:01 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.454s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:01 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img Apr 02 10:36:01 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:03 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img" returned: 0 in 1.825s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edec769-16fc-4267-b728-fcd9285f96dc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:03 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:36:03 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:03 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.579s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:36:03 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Converted 1024.00 MB image at 560.71 MB/s Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] 8beea1e3-63f7-43ed-aedb-a062e3357cb1 was raw, converting to qcow2 {{(pid=82391) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98763317-8bb8-44b7-947b-e0a74e5c270d]: (4, 'raw') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:03 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img Apr 02 10:36:03 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:04 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img" returned: 0 in 0.457s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:04 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img Apr 02 10:36:04 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:04 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img" returned: 1 in 0.459s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img' failed. Not Retrying. {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 02 10:36:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img /opt/stack/data/cinder/conversion/vol_upload_c7vawdta {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:04 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img /opt/stack/data/cinder/conversion/vol_upload_c7vawdta Apr 02 10:36:04 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:05 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img /opt/stack/data/cinder/conversion/vol_upload_c7vawdta" returned: 0 in 0.392s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:05 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Image conversion details: src /opt/stack/data/cinder/conversion/f4ce6fc2-652b-4eb5-b350-6b43435d561c.temp_image.8beea1e3-63f7-43ed-aedb-a062e3357cb1kk68wsrm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_c7vawdta {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:36:05 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 02 10:36:05 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eae413-18be-4f5d-8f90-297a0db514bb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c7vawdta {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:05 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c7vawdta Apr 02 10:36:05 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:05 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c7vawdta" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.914s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Uploaded volume to glance image-id: 8beea1e3-63f7-43ed-aedb-a062e3357cb1. {{(pid=82391) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 02 10:36:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c85b19f4-c2f5-4f74-aee2-7eb5d6043c70 tempest-VolumesActionsTest-608298695 None] Copy volume to image completed successfully. Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Acquiring lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Acquiring lock "cinder-quobyte-f4ce6fc2-652b-4eb5-b350-6b43435d561c" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Lock "cinder-quobyte-f4ce6fc2-652b-4eb5-b350-6b43435d561c" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae3db17-adb5-4dbd-869c-177657e5c528]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:07 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:36:07 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:07 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.436s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:07 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c Apr 02 10:36:07 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:07 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-f4ce6fc2-652b-4eb5-b350-6b43435d561c" returned: 0 in 0.373s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Lock "cinder-quobyte-f4ce6fc2-652b-4eb5-b350-6b43435d561c" released by "delete_volume" :: held 0.836s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Created reservations ['0c63b546-525c-4840-9832-cf637035741e', '4eb8c860-00d5-41f6-a7af-dd292e156747', 'f51061da-88ff-452d-8c09-b536cdf125d5', 'b56c8e68-0c47-4426-b19e-cfdc1522b9fd'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:08 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:08 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:08 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.411s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:08 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:08 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Deleted volume successfully. Apr 02 10:36:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d40aed3a-6242-4d7b-b83e-dc7ae5597b45 tempest-VolumesActionsTest-608298695 None] Lock "cinder-f4ce6fc2-652b-4eb5-b350-6b43435d561c-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Flow 'volume_create_manager' (710de85b-de6c-4d9c-ae8b-cb4927730457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a5a24e-4c15-4ea1-9ebc-37e40c0d4cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a5a24e-4c15-4ea1-9ebc-37e40c0d4cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-370550240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52889c04c16413d997514a0699e6192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:12Z,use_quota=True,user_id='c95f0a52ae974bd49c6984e26327f789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c06838e-9985-4b97-8066-5ea135e2c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c06838e-9985-4b97-8066-5ea135e2c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaacfd66-0319-4e1b-af9b-f6fdb57084fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaacfd66-0319-4e1b-af9b-f6fdb57084fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'volume_name': 'volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85267e7b-8bce-4d4d-a9b4-02d1a5e04514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85267e7b-8bce-4d4d-a9b4-02d1a5e04514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c331848d-943c-4214-9ceb-9253a63c9f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:11 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Volume 7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'volume_size': 1} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-370550240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52889c04c16413d997514a0699e6192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:12Z,use_quota=True,user_id='c95f0a52ae974bd49c6984e26327f789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Creating volume 7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:11 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:11 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 1073741824 Apr 02 10:36:11 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:12 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 1073741824" returned: 0 in 0.470s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:12 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:12 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:12 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.365s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c331848d-943c-4214-9ceb-9253a63c9f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a485abe2-96c4-46c2-9fce-e8d9a8422e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:12 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Volume volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 (7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6): created successfully Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a485abe2-96c4-46c2-9fce-e8d9a8422e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:12 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Flow 'volume_create_manager' (710de85b-de6c-4d9c-ae8b-cb4927730457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:12 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0e08c163-9965-4126-8e2e-02378deb4511 tempest-VolumesCloneTest-358497574 None] Created volume successfully. Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Flow 'volume_create_manager' (7390ab50-3531-41c3-9f89-d734a4f082e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ee05de-7f57-44f6-afa1-3acc8e60cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ee05de-7f57-44f6-afa1-3acc8e60cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1323041632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1f3073-f823-4606-979f-c86ad0c78e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b52889c04c16413d997514a0699e6192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:13Z,use_quota=True,user_id='c95f0a52ae974bd49c6984e26327f789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce6b289-b2b7-4acf-85fa-bff272aa1253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce6b289-b2b7-4acf-85fa-bff272aa1253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5de7a5c-07ee-4898-a813-b953d54a5737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5de7a5c-07ee-4898-a813-b953d54a5737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0c1f3073-f823-4606-979f-c86ad0c78e96', 'volume_name': 'volume-0c1f3073-f823-4606-979f-c86ad0c78e96', 'volume_size': 2, 'source_volid': '7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092c7ffa-c57e-4d35-8abd-2076fe156d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092c7ffa-c57e-4d35-8abd-2076fe156d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f6f5f0-3150-4683-99af-cf74a7cbdbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:13 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Volume 0c1f3073-f823-4606-979f-c86ad0c78e96: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0c1f3073-f823-4606-979f-c86ad0c78e96', 'volume_size': 2, 'source_volid': '7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'source_volstatus': 'available'} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:13 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Cloning volume 7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 to volume 0c1f3073-f823-4606-979f-c86ad0c78e96 Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Creating offline snapshot c16d56a3-66e9-48f2-b024-22bc331e3747 of volume 7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4575acd-dc89-4ac8-ab7a-990be5ca3872]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:13 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:13 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:13 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.431s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:13 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 1G Apr 02 10:36:13 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:14 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 1G" returned: 0 in 0.426s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:14 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 Apr 02 10:36:14 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:14 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747" returned: 0 in 0.387s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:14 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 is being set with open permissions: ugo+rw Apr 02 10:36:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:14 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 Apr 02 10:36:14 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:14 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747" returned: 0 in 0.364s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:14 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info Apr 02 10:36:14 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:15 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info" returned: 0 in 0.392s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:15 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info is being set with open permissions: ugo+rw Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:15 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info Apr 02 10:36:15 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:15 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.info" returned: 0 in 0.372s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Acquiring lock "cinder-quobyte-0c1f3073-f823-4606-979f-c86ad0c78e96" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-0c1f3073-f823-4606-979f-c86ad0c78e96" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] snapshot: c16d56a3-66e9-48f2-b024-22bc331e3747, volume: 0c1f3073-f823-4606-979f-c86ad0c78e96, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be5366-e1e2-4312-8725-66f15b8edf40]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:15 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 Apr 02 10:36:15 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:16 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b8019-ed90-4eff-b094-e3d697bc798d]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:16 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:16 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:16 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.438s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:36:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:16 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 Apr 02 10:36:16 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:18 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96" returned: 0 in 1.953s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:18 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf9a322-38b7-4c9a-8ecf-6977f0ab4b6a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:18 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:18 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:19 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.607s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:36:19 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Converted 1024.00 MB image at 523.93 MB/s Apr 02 10:36:19 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 is being set with open permissions: ugo+rw Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:19 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 Apr 02 10:36:19 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:19 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96" returned: 0 in 0.435s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-0c1f3073-f823-4606-979f-c86ad0c78e96" released by "_copy_volume_from_snapshot" :: held 3.907s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Acquiring lock "cinder-quobyte-c16d56a3-66e9-48f2-b024-22bc331e3747" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-c16d56a3-66e9-48f2-b024-22bc331e3747" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Deleting offline snapshot c16d56a3-66e9-48f2-b024-22bc331e3747 of volume 7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] snapshot_file for this snap is: volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c78d339-cc9e-4356-ad54-081d2d6a69da]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:19 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 Apr 02 10:36:19 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:20 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747" returned: 0 in 0.441s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaf22f7-83d3-4ecb-b3a1-82c3e5e13b51]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:20 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:20 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:20 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:20 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 Apr 02 10:36:20 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:20 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747" returned: 0 in 0.427s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:20 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747 Apr 02 10:36:20 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:21 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6.c16d56a3-66e9-48f2-b024-22bc331e3747" returned: 0 in 0.381s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-c16d56a3-66e9-48f2-b024-22bc331e3747" released by "_delete_snapshot" :: held 1.733s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.125s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f6f5f0-3150-4683-99af-cf74a7cbdbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1f3073-f823-4606-979f-c86ad0c78e96', 'volume_size': 2, 'source_volid': '7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686f4d1f-11f1-41f9-977d-6d4303a096af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:21 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Volume volume-0c1f3073-f823-4606-979f-c86ad0c78e96 (0c1f3073-f823-4606-979f-c86ad0c78e96): created successfully Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686f4d1f-11f1-41f9-977d-6d4303a096af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Flow 'volume_create_manager' (7390ab50-3531-41c3-9f89-d734a4f082e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-127354c5-8e9a-4c30-80f8-aa6f8ce6c98d tempest-VolumesCloneTest-358497574 None] Created volume successfully. Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Acquiring lock "cinder-0c1f3073-f823-4606-979f-c86ad0c78e96-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Lock "cinder-0c1f3073-f823-4606-979f-c86ad0c78e96-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Acquiring lock "cinder-quobyte-0c1f3073-f823-4606-979f-c86ad0c78e96" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-0c1f3073-f823-4606-979f-c86ad0c78e96" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e1f6de-17c7-449c-8e20-8a01a0d87bf3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:21 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 Apr 02 10:36:21 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:22 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96" returned: 0 in 0.440s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:22 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96 Apr 02 10:36:22 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:22 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-0c1f3073-f823-4606-979f-c86ad0c78e96" returned: 0 in 0.382s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-0c1f3073-f823-4606-979f-c86ad0c78e96" released by "delete_volume" :: held 0.843s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Created reservations ['2ddc1155-00f3-4828-9035-f54c0eba3a25', 'cc6431e8-7184-4ed4-bd38-aaa8c5af2b65', '0138587a-ba8b-434f-a669-723b7c49aaaf', '68c4edcf-4035-4c0c-8068-cfd22a6a6ad2'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:22 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:22 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Acquiring lock "cinder-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Lock "cinder-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Acquiring lock "cinder-quobyte-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5329eb-19ce-44cb-9b08-58babe5d4e48]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:23 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:23 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:23 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.442s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Deleted volume successfully. Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9e98fd76-2295-43dd-b5c6-54f2f0d5b8ec tempest-VolumesCloneTest-358497574 None] Lock "cinder-0c1f3073-f823-4606-979f-c86ad0c78e96-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:23 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.457s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:23 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6 Apr 02 10:36:23 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:23 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" returned: 0 in 0.373s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Lock "cinder-quobyte-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6" released by "delete_volume" :: held 0.866s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Created reservations ['5a2acb24-f739-4cfd-b989-fb80820404ab', 'af1b4899-ef1a-4360-9b20-fa2a970a6433', 'de30a20b-0c85-4e2d-8119-6e28ed0e50d0', '2e0cd170-c36e-46b1-a41b-b98221980ca2'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:23 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:23 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:24 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.431s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:24 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Deleted volume successfully. Apr 02 10:36:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7fbcf1d0-7442-4de6-a049-00f8066b0820 tempest-VolumesCloneTest-358497574 None] Lock "cinder-7a3a7f14-ebfe-415c-ac5f-fa0e4799abb6-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Flow 'volume_create_manager' (6452b5f7-be88-47e6-a243-798fdd25edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd9d3a-7a92-4d34-8f11-7ba980afb4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd9d3a-7a92-4d34-8f11-7ba980afb4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-637739992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ace35c-bf0a-452a-8784-10ef64961594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb6317e5ac24794bf01e4999ccc1d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:27Z,use_quota=True,user_id='09847de2d9f4439e8d05cf68397ad4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ffc380-73e9-4f65-953e-a5cb27fa4169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ffc380-73e9-4f65-953e-a5cb27fa4169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b158775-7382-423a-bc71-7e91d9ebe62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b158775-7382-423a-bc71-7e91d9ebe62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ace35c-bf0a-452a-8784-10ef64961594', 'volume_name': 'volume-a3ace35c-bf0a-452a-8784-10ef64961594', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e6e3dc-ea30-4d57-9f8d-6079250f8274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e6e3dc-ea30-4d57-9f8d-6079250f8274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522171a6-ea4e-410a-b58d-dcf46c9be32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:27 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Volume a3ace35c-bf0a-452a-8784-10ef64961594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ace35c-bf0a-452a-8784-10ef64961594', 'volume_size': 1} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-637739992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ace35c-bf0a-452a-8784-10ef64961594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb6317e5ac24794bf01e4999ccc1d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:27Z,use_quota=True,user_id='09847de2d9f4439e8d05cf68397ad4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Creating volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:27 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:27 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 1073741824 Apr 02 10:36:27 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:27 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 1073741824" returned: 0 in 0.451s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:27 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 Apr 02 10:36:27 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:28 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594" returned: 0 in 0.391s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522171a6-ea4e-410a-b58d-dcf46c9be32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ace35c-bf0a-452a-8784-10ef64961594', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9083819d-a25c-41ae-be2c-9071ffc3ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:28 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Volume volume-a3ace35c-bf0a-452a-8784-10ef64961594 (a3ace35c-bf0a-452a-8784-10ef64961594): created successfully Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9083819d-a25c-41ae-be2c-9071ffc3ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Flow 'volume_create_manager' (6452b5f7-be88-47e6-a243-798fdd25edd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:28 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f102eb48-077e-4d4d-a0c4-2078bc6999e9 tempest-VolumesSnapshotListTestJSON-407193694 None] Created volume successfully. Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Creating offline snapshot d8c5701f-8abb-4af3-a03e-b8bd66fb884c of volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacaea65-628b-4381-8d32-7006a5d90979]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:28 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 Apr 02 10:36:28 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:28 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594" returned: 0 in 0.459s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:28 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c 1G Apr 02 10:36:28 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:29 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c 1G" returned: 0 in 0.429s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:29 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:29 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:29 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.405s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:29 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c is being set with open permissions: ugo+rw Apr 02 10:36:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:29 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:29 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:29 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.367s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:30 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info Apr 02 10:36:30 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:30 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info" returned: 0 in 0.385s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:30 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info is being set with open permissions: ugo+rw Apr 02 10:36:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:30 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info Apr 02 10:36:30 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:30 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.info" returned: 0 in 0.375s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1a59ceac-502e-4e4b-b4a6-081232635562 tempest-VolumesSnapshotListTestJSON-407193694 None] Create snapshot completed successfully Apr 02 10:36:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:31 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Creating offline snapshot 24f42a49-ba39-42e3-85b8-f8bdd0378640 of volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:36:31 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3967b319-ea1c-4d23-b9fb-f0fea53935e0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:31 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:31 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:32 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:32 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 1G Apr 02 10:36:32 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:32 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 1G" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:32 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:32 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:32 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.413s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:32 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 is being set with open permissions: ugo+rw Apr 02 10:36:32 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:32 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:32 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:33 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.400s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:33 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8a601e6a-b0bc-4ec6-85d8-d5adabdb5ef3 tempest-VolumesSnapshotListTestJSON-407193694 None] Create snapshot completed successfully Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Creating offline snapshot 368f61ca-80ac-4a3f-9dd1-7e1446be5d9d of volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7520942-41b0-46d7-8470-abe79ec83dff]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:33 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:33 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:34 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.496s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:34 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d 1G Apr 02 10:36:34 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:34 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d 1G" returned: 0 in 0.527s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:34 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d Apr 02 10:36:34 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:35 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" returned: 0 in 0.407s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:35 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d is being set with open permissions: ugo+rw Apr 02 10:36:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:35 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d Apr 02 10:36:35 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:35 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" returned: 0 in 0.399s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:35 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d6691f70-4cb6-4c9d-9637-11e2921b3bd2 tempest-VolumesSnapshotListTestJSON-407193694 None] Create snapshot completed successfully Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-368f61ca-80ac-4a3f-9dd1-7e1446be5d9d-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-368f61ca-80ac-4a3f-9dd1-7e1446be5d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Deleting offline snapshot 368f61ca-80ac-4a3f-9dd1-7e1446be5d9d of volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] snapshot_file for this snap is: volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429ae4b-2f8e-44db-af41-53401b484b2b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:36 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d Apr 02 10:36:36 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:36 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d72848-b3bd-44f3-8ef8-cf21b40baa94]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:37 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:37 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:37 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:37 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d Apr 02 10:36:37 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:37 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" returned: 0 in 0.506s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:38 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d Apr 02 10:36:38 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:38 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" returned: 0 in 0.403s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-368f61ca-80ac-4a3f-9dd1-7e1446be5d9d" released by "_delete_snapshot" :: held 1.909s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" released by "delete_snapshot" :: held 1.923s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Created reservations ['e1d217a4-2f90-4570-9a35-ebeeb37f1a2e', '3b963db8-a683-491c-b43b-639e1e9adbab', 'd8d14be6-f718-4e54-85da-a22abd556bfe', '8ac51e9d-cb49-437a-bda2-829b606a3840'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Delete snapshot completed successfully. Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ad70e4e1-ec2a-427c-91bd-b3c84062cd02 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-368f61ca-80ac-4a3f-9dd1-7e1446be5d9d-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-24f42a49-ba39-42e3-85b8-f8bdd0378640-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-24f42a49-ba39-42e3-85b8-f8bdd0378640-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-24f42a49-ba39-42e3-85b8-f8bdd0378640" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-24f42a49-ba39-42e3-85b8-f8bdd0378640" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Deleting offline snapshot 24f42a49-ba39-42e3-85b8-f8bdd0378640 of volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] snapshot_file for this snap is: volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1494c09-e76a-47cb-8266-f357ad3bd105]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:38 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:38 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:39 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00327ab4-e5c1-4b92-a078-9b82dff9a63e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:39 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:39 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:39 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:39 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:39 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:40 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.459s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:40 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640 Apr 02 10:36:40 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:40 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.24f42a49-ba39-42e3-85b8-f8bdd0378640" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-24f42a49-ba39-42e3-85b8-f8bdd0378640" released by "_delete_snapshot" :: held 1.874s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" released by "delete_snapshot" :: held 1.891s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Created reservations ['fc1c7e7a-61f8-4bc9-8447-0a8c2c9e86aa', 'fa781564-7043-4b6d-a6cd-7c8c4fd1f5b2', '5d7fe5e4-9c75-4769-b948-0b29474225dc', '95998f5d-7c81-4810-b06d-92f9e439ea92'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Delete snapshot completed successfully. Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9741f055-6fc1-48e5-83a4-ae6f7e53db87 tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-24f42a49-ba39-42e3-85b8-f8bdd0378640-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-d8c5701f-8abb-4af3-a03e-b8bd66fb884c-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-d8c5701f-8abb-4af3-a03e-b8bd66fb884c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-d8c5701f-8abb-4af3-a03e-b8bd66fb884c" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-d8c5701f-8abb-4af3-a03e-b8bd66fb884c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Deleting offline snapshot d8c5701f-8abb-4af3-a03e-b8bd66fb884c of volume a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] snapshot_file for this snap is: volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06c7036-a466-458d-8d69-684b04eabfce]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:40 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:40 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:41 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ace35c-bf0a-452a-8784-10ef64961594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:36:41 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be172e-624e-4528-a049-cbde55a9d50f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:41 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 Apr 02 10:36:41 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:41 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:41 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:41 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:42 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:42 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c Apr 02 10:36:42 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:42 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594.d8c5701f-8abb-4af3-a03e-b8bd66fb884c" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-d8c5701f-8abb-4af3-a03e-b8bd66fb884c" released by "_delete_snapshot" :: held 1.916s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" released by "delete_snapshot" :: held 1.927s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Created reservations ['e9fc5eda-6d3c-4635-8c35-acdaf9ddfa68', 'cd0ca9ed-c4db-4a7b-b6d7-777a52263081', 'ad4428c3-4721-4c59-8176-49dca3f14364', '3a7126df-090c-45e4-be55-f8d4d3e45ae7'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:42 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Delete snapshot completed successfully. Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a4ea7c88-7fda-4fc1-9f0d-abf80712feaf tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-d8c5701f-8abb-4af3-a03e-b8bd66fb884c-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-a3ace35c-bf0a-452a-8784-10ef64961594-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-a3ace35c-bf0a-452a-8784-10ef64961594-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cecf62-6288-482c-a770-f56fb15f4000]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:43 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 Apr 02 10:36:43 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:43 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594" returned: 0 in 0.453s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:43 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594 Apr 02 10:36:43 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:43 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a3ace35c-bf0a-452a-8784-10ef64961594" returned: 0 in 0.425s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-quobyte-a3ace35c-bf0a-452a-8784-10ef64961594" released by "delete_volume" :: held 0.916s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Created reservations ['555ee93b-d219-4897-86a3-64336604c383', 'c23a76ed-9c5a-4579-ab76-4ef0a8b40b0f', '7edaffe2-9dcc-4d61-8967-7457c2a53982', 'b6ed7077-f369-4709-b6fc-312b2d8dec18'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:43 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:43 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:44 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:44 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Deleted volume successfully. Apr 02 10:36:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-888a6ac5-fafb-4532-b02f-d79c6aad39de tempest-VolumesSnapshotListTestJSON-407193694 None] Lock "cinder-a3ace35c-bf0a-452a-8784-10ef64961594-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (8418d28c-d20d-4a41-8d8d-d6dd02ae497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb82f84e-7705-4c8c-9abf-81747d683cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb82f84e-7705-4c8c-9abf-81747d683cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270147100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897c6d1a-c82f-4817-91f5-d9134a4d3139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac3d376-7455-4d18-997a-2e07d9a92cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac3d376-7455-4d18-997a-2e07d9a92cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35003e8e-f6d3-4769-b66b-3bf281e958b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35003e8e-f6d3-4769-b66b-3bf281e958b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897c6d1a-c82f-4817-91f5-d9134a4d3139', 'volume_name': 'volume-897c6d1a-c82f-4817-91f5-d9134a4d3139', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81bf704-e0ab-42b6-836d-7cea42e666c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81bf704-e0ab-42b6-836d-7cea42e666c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6e73a-8e96-45e4-af87-3094e0b866ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:45 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Volume 897c6d1a-c82f-4817-91f5-d9134a4d3139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897c6d1a-c82f-4817-91f5-d9134a4d3139', 'volume_size': 1} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270147100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897c6d1a-c82f-4817-91f5-d9134a4d3139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Creating volume 897c6d1a-c82f-4817-91f5-d9134a4d3139 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:45 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:45 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 1073741824 Apr 02 10:36:45 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (0153600b-b909-497d-9e9b-c7ec26db21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d4409a-e750-4d4a-8fd3-ccdcbb24908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d4409a-e750-4d4a-8fd3-ccdcbb24908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957675352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772708af-6f4c-40a9-b06c-7fd2367e0abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f573f4f5-7063-46b4-a85c-e5e3ba89fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f573f4f5-7063-46b4-a85c-e5e3ba89fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bb9906-2556-46e2-b8ae-18449db68bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bb9906-2556-46e2-b8ae-18449db68bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772708af-6f4c-40a9-b06c-7fd2367e0abd', 'volume_name': 'volume-772708af-6f4c-40a9-b06c-7fd2367e0abd', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4407f1a9-79d6-4eda-8897-eb9e4f7297ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4407f1a9-79d6-4eda-8897-eb9e4f7297ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe204ce1-b6a7-4fb8-9af9-2965c5b19dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Volume 772708af-6f4c-40a9-b06c-7fd2367e0abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772708af-6f4c-40a9-b06c-7fd2367e0abd', 'volume_size': 1} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (9a28bbbb-7525-443e-ab28-d7e6ff28f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e06829-be52-4848-9a66-6bd891a912c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:46 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:46 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e06829-be52-4848-9a66-6bd891a912c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399490002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c7c51b-9a8b-42bc-973f-da03b86e714f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71474560-7c66-46a6-9e5a-737ed143d4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71474560-7c66-46a6-9e5a-737ed143d4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a049c7-0fe5-4d6f-aa84-466773f956d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a049c7-0fe5-4d6f-aa84-466773f956d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c7c51b-9a8b-42bc-973f-da03b86e714f', 'volume_name': 'volume-41c7c51b-9a8b-42bc-973f-da03b86e714f', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7346646-87e0-4f0b-838d-142aaba7f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7346646-87e0-4f0b-838d-142aaba7f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc330a3-e46e-4b71-948f-655e94688879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Volume 41c7c51b-9a8b-42bc-973f-da03b86e714f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c7c51b-9a8b-42bc-973f-da03b86e714f', 'volume_size': 1} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (e33bba1a-d52f-4597-9dc3-1600e964a2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a031c49-1789-4c44-9ef1-01c5bcc1162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a031c49-1789-4c44-9ef1-01c5bcc1162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317418410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6212cdb5-6370-4826-866c-8b04243b09c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4795e3-f38f-474f-ad94-b89497232080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4795e3-f38f-474f-ad94-b89497232080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b8c7f1-cf25-489c-b254-ada2fcbe3a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b8c7f1-cf25-489c-b254-ada2fcbe3a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6212cdb5-6370-4826-866c-8b04243b09c0', 'volume_name': 'volume-6212cdb5-6370-4826-866c-8b04243b09c0', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e15679-3c78-4f7b-bd9d-8abc2f624a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e15679-3c78-4f7b-bd9d-8abc2f624a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d772af-1812-4af1-8a04-3bf182162dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Volume 6212cdb5-6370-4826-866c-8b04243b09c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6212cdb5-6370-4826-866c-8b04243b09c0', 'volume_size': 1} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:46 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 1073741824" returned: 0 in 0.600s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:46 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 Apr 02 10:36:46 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (ee6e9057-923e-434c-a785-dbc8ef0419b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43fef66-33c4-4b06-8dd8-54b25f362ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43fef66-33c4-4b06-8dd8-54b25f362ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-948887681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:47Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7718fcd-c423-4100-8b06-1da2662fc9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7718fcd-c423-4100-8b06-1da2662fc9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a7915c-80dd-4dba-85fe-f2081cec3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a7915c-80dd-4dba-85fe-f2081cec3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e', 'volume_name': 'volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90f1e7f-1435-4ff9-ba37-31d81cc27566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90f1e7f-1435-4ff9-ba37-31d81cc27566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f48bf5-21e0-44dd-9393-683527e3b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:46 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Volume e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e', 'volume_size': 1} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:46 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.497s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:47 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139" returned: 0 in 0.452s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957675352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772708af-6f4c-40a9-b06c-7fd2367e0abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Creating volume 772708af-6f4c-40a9-b06c-7fd2367e0abd {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:47 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6e73a-8e96-45e4-af87-3094e0b866ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897c6d1a-c82f-4817-91f5-d9134a4d3139', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb9e693-3f3d-4643-9121-c44fd1ea5450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:47 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd 1073741824 Apr 02 10:36:47 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:47 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Volume volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 (897c6d1a-c82f-4817-91f5-d9134a4d3139): created successfully Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb9e693-3f3d-4643-9121-c44fd1ea5450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (8418d28c-d20d-4a41-8d8d-d6dd02ae497f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:47 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-dd1cf8ab-3b10-4d4f-9e29-ad907da6c184 tempest-CreateVolumesFromImageTest-2068898301 None] Created volume successfully. Apr 02 10:36:47 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd 1073741824" returned: 0 in 0.512s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:47 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd Apr 02 10:36:47 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:47 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd" returned: 0 in 0.427s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399490002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c7c51b-9a8b-42bc-973f-da03b86e714f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Creating volume 41c7c51b-9a8b-42bc-973f-da03b86e714f {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:48 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe204ce1-b6a7-4fb8-9af9-2965c5b19dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772708af-6f4c-40a9-b06c-7fd2367e0abd', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb7869d-a46d-4a2c-b5a9-537cd9350c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:48 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f 1073741824 Apr 02 10:36:48 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:48 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Volume volume-772708af-6f4c-40a9-b06c-7fd2367e0abd (772708af-6f4c-40a9-b06c-7fd2367e0abd): created successfully Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb7869d-a46d-4a2c-b5a9-537cd9350c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (0153600b-b909-497d-9e9b-c7ec26db21f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-30de2320-ad66-4e57-afd2-ec8e1bdd11b1 tempest-CreateVolumesFromImageTest-2068898301 None] Created volume successfully. Apr 02 10:36:48 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f 1073741824" returned: 0 in 0.487s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:48 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f Apr 02 10:36:48 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:48 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f" returned: 0 in 0.431s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.439s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317418410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6212cdb5-6370-4826-866c-8b04243b09c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:46Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Creating volume 6212cdb5-6370-4826-866c-8b04243b09c0 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:48 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc330a3-e46e-4b71-948f-655e94688879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c7c51b-9a8b-42bc-973f-da03b86e714f', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea74bc2-cf37-4b0f-8e15-13e3dd66c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:48 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 1073741824 Apr 02 10:36:48 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:48 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Volume volume-41c7c51b-9a8b-42bc-973f-da03b86e714f (41c7c51b-9a8b-42bc-973f-da03b86e714f): created successfully Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea74bc2-cf37-4b0f-8e15-13e3dd66c93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:48 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (9a28bbbb-7525-443e-ab28-d7e6ff28f931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:49 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-089a2571-deb4-46f5-8a57-3420049ed0c5 tempest-CreateVolumesFromImageTest-2068898301 None] Created volume successfully. Apr 02 10:36:49 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 1073741824" returned: 0 in 0.521s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:49 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 Apr 02 10:36:49 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:49 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0" returned: 0 in 0.460s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-948887681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd4a102aab744bbac54ab999d62822c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:36:47Z,use_quota=True,user_id='16921373a72744ab805e7b0097f1b259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Creating volume e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:36:49 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d772af-1812-4af1-8a04-3bf182162dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6212cdb5-6370-4826-866c-8b04243b09c0', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:49 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e 1073741824 Apr 02 10:36:49 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:49 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6444660c-e64d-4f7c-8fe4-8e3ca7dce911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Volume volume-6212cdb5-6370-4826-866c-8b04243b09c0 (6212cdb5-6370-4826-866c-8b04243b09c0): created successfully Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6444660c-e64d-4f7c-8fe4-8e3ca7dce911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (e33bba1a-d52f-4597-9dc3-1600e964a2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c28a5645-5517-4d6a-8e2f-b6d84aacb06b tempest-CreateVolumesFromImageTest-2068898301 None] Created volume successfully. Apr 02 10:36:50 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e 1073741824" returned: 0 in 0.562s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:50 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e Apr 02 10:36:50 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:50 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e" returned: 0 in 0.409s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f48bf5-21e0-44dd-9393-683527e3b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58775a93-9e37-42ee-b5b2-93261663e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:36:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Volume volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e (e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e): created successfully Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58775a93-9e37-42ee-b5b2-93261663e576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:36:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Flow 'volume_create_manager' (ee6e9057-923e-434c-a785-dbc8ef0419b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:36:51 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c2b60d6f-11b0-4409-a155-befb431d4a2c tempest-CreateVolumesFromImageTest-2068898301 None] Created volume successfully. Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-quobyte-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72607eea-237c-458b-9e55-12ec77025e40]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:51 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e Apr 02 10:36:51 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:51 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e" returned: 0 in 0.515s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:51 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e Apr 02 10:36:51 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:52 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e" returned: 0 in 0.421s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e" released by "delete_volume" :: held 0.961s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Created reservations ['b2a976be-db89-4aa9-b60d-66b17b86d30d', 'd41f3ba8-d88f-47e5-b2fd-6f2f848a6d0b', '461b5f9a-7b4a-4a7b-99b3-2439a88e1597', 'b56d15ae-f3c0-4e5b-bff2-2d821524eda8'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:52 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:52 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-6212cdb5-6370-4826-866c-8b04243b09c0-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-6212cdb5-6370-4826-866c-8b04243b09c0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-quobyte-6212cdb5-6370-4826-866c-8b04243b09c0" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-6212cdb5-6370-4826-866c-8b04243b09c0" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4abdf9-e90f-4b64-8012-6e3c3e667fa4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:52 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 Apr 02 10:36:52 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:52 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Deleted volume successfully. Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f0aeab50-f0ba-4b8e-bb66-f5d0396f5e20 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-e95bf7a5-ee4e-48fa-bea0-52e7c8a3fe7e-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:52 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0" returned: 0 in 0.582s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:52 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0 Apr 02 10:36:52 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:53 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6212cdb5-6370-4826-866c-8b04243b09c0" returned: 0 in 0.520s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-6212cdb5-6370-4826-866c-8b04243b09c0" released by "delete_volume" :: held 1.132s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Created reservations ['6b47a514-0541-4b8f-9191-2a7724604ee0', '70992981-f8f5-4a1b-a20e-d70fc53b6dfb', 'eb416604-6b79-48a9-b1b7-d7829a5f1933', '4ac1b6d6-7861-4ae8-ba3c-12234b77b5c9'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:53 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:53 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:54 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.491s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Deleted volume successfully. Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5f7c7af9-535b-4012-bf68-44259dba7c07 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-6212cdb5-6370-4826-866c-8b04243b09c0-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-41c7c51b-9a8b-42bc-973f-da03b86e714f-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-41c7c51b-9a8b-42bc-973f-da03b86e714f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-quobyte-41c7c51b-9a8b-42bc-973f-da03b86e714f" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-41c7c51b-9a8b-42bc-973f-da03b86e714f" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdbfd7f-02ba-454b-95ee-e8a1703779a1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:54 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f Apr 02 10:36:54 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:55 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f" returned: 0 in 0.494s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:55 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f Apr 02 10:36:55 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:55 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-41c7c51b-9a8b-42bc-973f-da03b86e714f" returned: 0 in 0.447s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-41c7c51b-9a8b-42bc-973f-da03b86e714f" released by "delete_volume" :: held 0.967s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Created reservations ['41e6f847-77cf-4c3e-bb3a-48aa6f70c024', 'a5ea89ba-2606-4333-bd9a-d943fe8ac4bd', 'dc4207a7-ffd0-482c-80c5-82eec0884e00', '952a033b-2cf2-4366-a9c0-d1d82bf985df'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:55 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:55 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-772708af-6f4c-40a9-b06c-7fd2367e0abd-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-772708af-6f4c-40a9-b06c-7fd2367e0abd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=83,cinder:UPDATE=97,cinder:DELETE=9,cinder:INSERT=21 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-quobyte-772708af-6f4c-40a9-b06c-7fd2367e0abd" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-772708af-6f4c-40a9-b06c-7fd2367e0abd" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffb32b-459a-414a-8cb6-a61631483910]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:55 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd Apr 02 10:36:55 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:56 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.464s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Deleted volume successfully. Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-028a9dd5-77e9-4032-841a-10de526d9e59 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-41c7c51b-9a8b-42bc-973f-da03b86e714f-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:56 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd" returned: 0 in 0.491s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:56 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd Apr 02 10:36:56 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:56 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-772708af-6f4c-40a9-b06c-7fd2367e0abd" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-772708af-6f4c-40a9-b06c-7fd2367e0abd" released by "delete_volume" :: held 0.962s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Created reservations ['7927d8f5-6514-46fc-8165-6d4f79606d5b', '642f8f17-dedd-4382-8c20-444bad5f5a44', 'c5777fa6-b7e3-4388-9e1b-0841465506bb', '76b064c3-86d5-4ded-b7a2-a63341ec741b'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:56 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:56 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-897c6d1a-c82f-4817-91f5-d9134a4d3139-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-897c6d1a-c82f-4817-91f5-d9134a4d3139-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "cinder-quobyte-897c6d1a-c82f-4817-91f5-d9134a4d3139" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-897c6d1a-c82f-4817-91f5-d9134a4d3139" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63abe257-24a3-4380-90d1-2cc22bb8eb9f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:36:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:56 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 Apr 02 10:36:56 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:57 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:57 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Deleted volume successfully. Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-34999acf-4bfe-4139-bd59-170535a12a89 tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-772708af-6f4c-40a9-b06c-7fd2367e0abd-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:57 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139" returned: 0 in 0.551s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:57 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139 Apr 02 10:36:57 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:57 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-897c6d1a-c82f-4817-91f5-d9134a4d3139" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-quobyte-897c6d1a-c82f-4817-91f5-d9134a4d3139" released by "delete_volume" :: held 1.015s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Created reservations ['4a883652-b5de-4963-b6f9-ab8cf63e2b08', 'e8959f0a-4b5a-4a23-ba48-f3d87643804c', 'a0b26b37-ec95-402c-bb9e-fa601ab75741', '4a876340-41b3-49f4-89e8-a9c9257719d6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:36:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:36:57 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:36:57 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:36:58 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 02 10:36:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.436s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:36:58 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:36:58 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Deleted volume successfully. Apr 02 10:36:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-4775616c-abdc-4998-b6b0-696955c216dc tempest-CreateVolumesFromImageTest-2068898301 None] Lock "cinder-897c6d1a-c82f-4817-91f5-d9134a4d3139-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=133,cinder:SELECT=94,cinder:INSERT=35,cinder:DELETE=8 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Flow 'volume_create_manager' (4ff5576a-7bb2-4ec4-a4f0-0dfe4a9c3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79f13e1-88b6-4b9a-92bf-1d0da71b2020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79f13e1-88b6-4b9a-92bf-1d0da71b2020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b47d217-606d-4e78-aad5-f19349821983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f42bd44aaf4f3c8e08ccd55a3e0873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:01Z,use_quota=True,user_id='068645f8df2849a596e4b65ad49e8631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd566837-1303-451b-8cba-513b1fd2f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd566837-1303-451b-8cba-513b1fd2f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093e2d3c-d309-40e5-981a-86770a787c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093e2d3c-d309-40e5-981a-86770a787c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b47d217-606d-4e78-aad5-f19349821983', 'volume_name': 'volume-7b47d217-606d-4e78-aad5-f19349821983', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2495660c-d087-46c7-b217-922e91247066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2495660c-d087-46c7-b217-922e91247066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9304c41c-01f9-4ea3-90f9-23eef03c13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:00 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Volume 7b47d217-606d-4e78-aad5-f19349821983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b47d217-606d-4e78-aad5-f19349821983', 'volume_size': 1} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b47d217-606d-4e78-aad5-f19349821983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f42bd44aaf4f3c8e08ccd55a3e0873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:01Z,use_quota=True,user_id='068645f8df2849a596e4b65ad49e8631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Creating volume 7b47d217-606d-4e78-aad5-f19349821983 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:37:00 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:37:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:00 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 1073741824 Apr 02 10:37:00 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:01 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 1073741824" returned: 0 in 0.597s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:01 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 Apr 02 10:37:01 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:01 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983" returned: 0 in 0.521s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:37:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9304c41c-01f9-4ea3-90f9-23eef03c13b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b47d217-606d-4e78-aad5-f19349821983', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7301350-edc4-4eb1-9e22-0109dbaf0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Volume volume-7b47d217-606d-4e78-aad5-f19349821983 (7b47d217-606d-4e78-aad5-f19349821983): created successfully Apr 02 10:37:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7301350-edc4-4eb1-9e22-0109dbaf0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Flow 'volume_create_manager' (4ff5576a-7bb2-4ec4-a4f0-0dfe4a9c3a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:02 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-da7e2300-3c98-4e1d-81c7-5a00f008381c tempest-CinderUnicodeTest-2060639954 None] Created volume successfully. Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Flow 'volume_create_manager' (0e9c09f7-d301-40cb-b957-20186ac317e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8364458b-9037-4209-8555-f6cccbbc4a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8364458b-9037-4209-8555-f6cccbbc4a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2066276270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e69fd6-5255-4392-b615-f05726040dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f42bd44aaf4f3c8e08ccd55a3e0873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:03Z,use_quota=True,user_id='068645f8df2849a596e4b65ad49e8631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae147c7-5699-4a4b-9584-172566856675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae147c7-5699-4a4b-9584-172566856675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36018471-6dd4-4818-9778-a455a86a87d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36018471-6dd4-4818-9778-a455a86a87d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e69fd6-5255-4392-b615-f05726040dcc', 'volume_name': 'volume-09e69fd6-5255-4392-b615-f05726040dcc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3a9038-0a31-406f-a05a-49723a205e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3a9038-0a31-406f-a05a-49723a205e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b8208f-def6-4e75-845f-41f279ea45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:03 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Volume 09e69fd6-5255-4392-b615-f05726040dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e69fd6-5255-4392-b615-f05726040dcc', 'volume_size': 1} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2066276270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e69fd6-5255-4392-b615-f05726040dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f42bd44aaf4f3c8e08ccd55a3e0873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:03Z,use_quota=True,user_id='068645f8df2849a596e4b65ad49e8631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Creating volume 09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:37:03 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:03 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc 1073741824 Apr 02 10:37:03 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:03 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc 1073741824" returned: 0 in 0.512s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:03 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc Apr 02 10:37:03 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:04 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc" returned: 0 in 0.460s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b8208f-def6-4e75-845f-41f279ea45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e69fd6-5255-4392-b615-f05726040dcc', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61b60a9-f823-4a86-89d2-ea8951240dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:04 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Volume volume-09e69fd6-5255-4392-b615-f05726040dcc (09e69fd6-5255-4392-b615-f05726040dcc): created successfully Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61b60a9-f823-4a86-89d2-ea8951240dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Flow 'volume_create_manager' (0e9c09f7-d301-40cb-b957-20186ac317e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:04 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d9957ba9-eb9f-4e1f-b669-8b9ab43c0a01 tempest-CinderUnicodeTest-2060639954 None] Created volume successfully. Apr 02 10:37:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Creating offline snapshot 0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 of volume 09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:37:05 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af363ac-adfd-43ff-a3b8-f9514bd2e36b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:05 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc Apr 02 10:37:05 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:06 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc" returned: 0 in 0.498s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:06 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 1G Apr 02 10:37:06 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:06 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 1G" returned: 0 in 0.533s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e69fd6-5255-4392-b615-f05726040dcc -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:06 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e69fd6-5255-4392-b615-f05726040dcc -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 Apr 02 10:37:06 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:07 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e69fd6-5255-4392-b615-f05726040dcc -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" returned: 0 in 0.457s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:07 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 is being set with open permissions: ugo+rw Apr 02 10:37:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:07 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 Apr 02 10:37:07 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:07 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" returned: 0 in 0.435s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:07 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info Apr 02 10:37:07 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:07 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info" returned: 0 in 0.413s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:07 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info is being set with open permissions: ugo+rw Apr 02 10:37:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:07 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info Apr 02 10:37:07 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:08 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.info" returned: 0 in 0.429s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:08 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-761d30a9-3d2e-4b3a-bcbe-266194f4cb5e tempest-CinderUnicodeTest-2060639954 None] Create snapshot completed successfully Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-quobyte-09e69fd6-5255-4392-b615-f05726040dcc" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-09e69fd6-5255-4392-b615-f05726040dcc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-quobyte-0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Deleting offline snapshot 0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 of volume 09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] snapshot_file for this snap is: volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f6d186-3cee-4009-9e7c-f568e33c4a81]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:08 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 Apr 02 10:37:08 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:09 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" returned: 0 in 0.521s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e69fd6-5255-4392-b615-f05726040dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:37:09 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4774f9f6-3bc2-45ed-9570-145a5ca8ddd4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:09 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc Apr 02 10:37:09 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:09 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc" returned: 0 in 0.507s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:09 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 Apr 02 10:37:09 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:10 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" returned: 0 in 0.496s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:10 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6 Apr 02 10:37:10 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:10 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc.0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" returned: 0 in 0.435s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6" released by "_delete_snapshot" :: held 2.031s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-09e69fd6-5255-4392-b615-f05726040dcc" released by "delete_snapshot" :: held 2.046s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Created reservations ['7c529cc6-0ccd-4ce9-a451-ce468bce4fd5', '7aff22b5-0f70-4e6b-97fa-3f94d1048375', '28be78da-cf11-431f-9ad6-9a28ef98cdb9', 'a02bc297-56af-45dc-a39b-ffede99bdd57'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:37:10 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Delete snapshot completed successfully. Apr 02 10:37:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8861a594-aaea-4c47-840f-e7a518699ef6 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-0e06eafc-faee-4f7f-9ecf-d5c24e7b7be6-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-09e69fd6-5255-4392-b615-f05726040dcc-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-09e69fd6-5255-4392-b615-f05726040dcc-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-quobyte-09e69fd6-5255-4392-b615-f05726040dcc" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-09e69fd6-5255-4392-b615-f05726040dcc" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:11 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df19aac-e2d6-44a9-adbb-f216fff2b8bd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:11 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc Apr 02 10:37:11 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:12 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc" returned: 0 in 0.538s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:12 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc Apr 02 10:37:12 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:12 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-09e69fd6-5255-4392-b615-f05726040dcc" returned: 0 in 0.524s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-09e69fd6-5255-4392-b615-f05726040dcc" released by "delete_volume" :: held 1.097s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Created reservations ['d4d8846f-d238-4221-8e32-1ea6bf90c840', '9b255898-e3a2-4bb8-9074-87c004741354', 'a203ae3a-0061-40d2-826b-ca1bc7ec83b7', '1f52227d-9e37-4790-bc8a-2aa15f21a87e'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:13 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:37:13 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:13 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.533s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:37:13 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Deleted volume successfully. Apr 02 10:37:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e94c4f36-c715-4884-95c8-1bb2c3789c08 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-09e69fd6-5255-4392-b615-f05726040dcc-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-7b47d217-606d-4e78-aad5-f19349821983-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-7b47d217-606d-4e78-aad5-f19349821983-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "cinder-quobyte-7b47d217-606d-4e78-aad5-f19349821983" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-7b47d217-606d-4e78-aad5-f19349821983" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e7935-aff8-4d45-884e-7cd173be15c1]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:14 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 Apr 02 10:37:14 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:14 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983" returned: 0 in 0.486s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:14 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983 Apr 02 10:37:14 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:14 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7b47d217-606d-4e78-aad5-f19349821983" returned: 0 in 0.414s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-quobyte-7b47d217-606d-4e78-aad5-f19349821983" released by "delete_volume" :: held 0.926s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Created reservations ['ff534920-1845-428a-86ac-356a7e7bd950', '8255663b-1ab3-47e9-a0cf-12d5c4f84205', '6814fa72-791b-4d0b-b9ab-3283fff36769', '856cb7f2-94c6-4c88-843f-bc214f794a70'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:15 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:37:15 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:15 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.444s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:37:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Deleted volume successfully. Apr 02 10:37:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a51819d8-7da5-4fc5-95a4-c6e0671ad077 tempest-CinderUnicodeTest-2060639954 None] Lock "cinder-7b47d217-606d-4e78-aad5-f19349821983-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:25 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:INSERT=9,cinder:DELETE=2,cinder:SELECT=23,cinder:UPDATE=24 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:37:25 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:DELETE=6,cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=42 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Flow 'volume_create_manager' (6660b72a-a891-4441-8f6a-8bfea38dd191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7956a8-b8fb-43ef-91d7-a5ace4071f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7956a8-b8fb-43ef-91d7-a5ace4071f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-584958929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07681ae7-0010-4a4f-bf9d-a3ab6fd1865e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8760b66c5a4bab91c6d029daea7259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:35Z,use_quota=True,user_id='6496dca4fb37434c82f3d7e3bd820dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36a1112-a891-496d-b308-84e19c37ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36a1112-a891-496d-b308-84e19c37ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e0f02c-717f-4a25-bce7-8b925fbaf4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e0f02c-717f-4a25-bce7-8b925fbaf4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07681ae7-0010-4a4f-bf9d-a3ab6fd1865e', 'volume_name': 'volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a97638b-acb8-46d8-b8b9-3d16b3151b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a97638b-acb8-46d8-b8b9-3d16b3151b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3aacc9-53e4-4273-861f-5684fc584534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:34 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Volume 07681ae7-0010-4a4f-bf9d-a3ab6fd1865e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e', 'volume_size': 1} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-584958929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07681ae7-0010-4a4f-bf9d-a3ab6fd1865e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8760b66c5a4bab91c6d029daea7259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:35Z,use_quota=True,user_id='6496dca4fb37434c82f3d7e3bd820dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Creating volume 07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:37:34 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:37:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:34 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e 1073741824 Apr 02 10:37:34 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:35 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e 1073741824" returned: 0 in 0.466s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:35 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:35 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:35 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.417s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3aacc9-53e4-4273-861f-5684fc584534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e927659-6870-4676-a3e0-91e2c67fe6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:35 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Volume volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e (07681ae7-0010-4a4f-bf9d-a3ab6fd1865e): created successfully Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e927659-6870-4676-a3e0-91e2c67fe6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Flow 'volume_create_manager' (6660b72a-a891-4441-8f6a-8bfea38dd191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:35 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ce35dfb4-3868-4680-b3dd-1ed483927fef tempest-SnapshotDependencyTests-1579021612 None] Created volume successfully. Apr 02 10:37:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Creating offline snapshot 58ef1cd2-c4fe-4b0c-905c-4182cf1a786a of volume 07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:37:36 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b06edc-ce32-4524-a850-8c4c84dc9370]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:36 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:36 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:37 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.453s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:37 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a 1G Apr 02 10:37:37 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:37 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a 1G" returned: 0 in 0.472s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:37 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a Apr 02 10:37:37 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:38 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" returned: 0 in 0.461s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:38 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a is being set with open permissions: ugo+rw Apr 02 10:37:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:38 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a Apr 02 10:37:38 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:38 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" returned: 0 in 0.393s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:38 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info Apr 02 10:37:38 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:39 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info" returned: 0 in 0.407s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:39 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info is being set with open permissions: ugo+rw Apr 02 10:37:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:39 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info Apr 02 10:37:39 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:39 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.info" returned: 0 in 0.392s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:39 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-98805378-bd0a-4eea-bbd2-b528ba672870 tempest-SnapshotDependencyTests-1579021612 None] Create snapshot completed successfully Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Flow 'volume_create_manager' (07f78e79-a7aa-48b3-be9c-4072a525e117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ffa05b-2ff3-4364-902f-ed4a716aea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ffa05b-2ff3-4364-902f-ed4a716aea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f149801-f6f9-4f8c-b4f5-387a64fdf0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd8760b66c5a4bab91c6d029daea7259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58ef1cd2-c4fe-4b0c-905c-4182cf1a786a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:37:40Z,use_quota=True,user_id='6496dca4fb37434c82f3d7e3bd820dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad91a2d-ce11-4a05-9420-b68c72439e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad91a2d-ce11-4a05-9420-b68c72439e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa610ab7-46cf-4930-89f4-abc4016bfd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa610ab7-46cf-4930-89f4-abc4016bfd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f149801-f6f9-4f8c-b4f5-387a64fdf0b0', 'volume_name': 'volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0', 'volume_size': 1, 'snapshot_id': '58ef1cd2-c4fe-4b0c-905c-4182cf1a786a'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5450cf-dcae-4f60-b86c-8d9f17683db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5450cf-dcae-4f60-b86c-8d9f17683db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7695b0-60c4-41b1-8ec5-14ba7f87f08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:40 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Volume 9f149801-f6f9-4f8c-b4f5-387a64fdf0b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0', 'volume_size': 1, 'snapshot_id': '58ef1cd2-c4fe-4b0c-905c-4182cf1a786a'} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-quobyte-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Creating volume 9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 from snapshot 58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-quobyte-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] snapshot: 58ef1cd2-c4fe-4b0c-905c-4182cf1a786a, volume: 9f149801-f6f9-4f8c-b4f5-387a64fdf0b0, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ffd2dd-a330-49a5-85df-9e6c6cd39e3b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:40 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a Apr 02 10:37:40 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:40 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" returned: 0 in 0.462s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208d48f-c199-4246-b824-78ec07176cfd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:40 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:40 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:41 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:41 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:37:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:41 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 Apr 02 10:37:41 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:43 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" returned: 0 in 1.934s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:43 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218a545-4a2c-4841-933d-a8a7bba160f0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:43 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:43 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:43 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.584s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:43 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:37:43 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Converted 1024.00 MB image at 529.17 MB/s Apr 02 10:37:43 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 is being set with open permissions: ugo+rw Apr 02 10:37:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:43 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 Apr 02 10:37:43 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:44 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" returned: 0 in 0.395s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" released by "_copy_volume_from_snapshot" :: held 3.898s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" released by "_create_volume_from_snapshot" :: held 3.915s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.924s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7695b0-60c4-41b1-8ec5-14ba7f87f08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0', 'volume_size': 1, 'snapshot_id': '58ef1cd2-c4fe-4b0c-905c-4182cf1a786a'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b559f8-f18c-450f-80aa-14d53716b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:37:44 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Volume volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 (9f149801-f6f9-4f8c-b4f5-387a64fdf0b0): created successfully Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b559f8-f18c-450f-80aa-14d53716b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Flow 'volume_create_manager' (07f78e79-a7aa-48b3-be9c-4072a525e117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:37:44 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-251a84b8-6e6c-41cb-933d-0e8ba65f29e7 tempest-SnapshotDependencyTests-1579021612 None] Created volume successfully. Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-quobyte-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-quobyte-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Deleting offline snapshot 58ef1cd2-c4fe-4b0c-905c-4182cf1a786a of volume 07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] snapshot_file for this snap is: volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c74c93-b625-40a1-a1ff-fd00ee1e9cb3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:44 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a Apr 02 10:37:44 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:45 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" returned: 0 in 0.449s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:45 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:37:45 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0c459-bffb-456c-ac2f-4d20f089dacc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:45 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:45 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:45 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.452s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:45 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a Apr 02 10:37:45 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:46 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" returned: 0 in 0.440s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:46 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a Apr 02 10:37:46 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:46 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:37:46 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:46 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e.58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" returned: 0 in 0.410s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a" released by "_delete_snapshot" :: held 1.807s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" released by "delete_snapshot" :: held 1.819s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Created reservations ['f7549cb8-b9a6-4b14-a5f0-2ae6ca8bb10f', 'fedc9663-3511-4aad-831b-040938cd9d0b', '830877dd-2ce4-4f68-9922-730446158fc2', '9c09d48d-38ff-4f5d-bb2a-ea7d435c337d'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:37:46 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Delete snapshot completed successfully. Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d8e5a3f1-320f-4e84-9d15-3a0d23ddddab tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-58ef1cd2-c4fe-4b0c-905c-4182cf1a786a-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-quobyte-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:46 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.446s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5377743a-a35b-4ff4-96d5-f0c9d389da15]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:46 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:46 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:47 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.463s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:47 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e Apr 02 10:37:47 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:47 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" returned: 0 in 0.391s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e" released by "delete_volume" :: held 0.890s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Created reservations ['98a0c781-824a-4aa7-a6da-799736face79', 'ea857dba-cba0-4899-bad5-19222339ad26', '8784f38e-a2a6-4ba8-b101-8bfc36f86103', '550ab7cf-9ebc-4438-8b23-b21bdbb51aac'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:47 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:37:47 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "cinder-quobyte-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb605f62-745b-4316-a502-cf19ce612b35]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:37:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:47 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 Apr 02 10:37:47 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:48 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.422s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:37:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Deleted volume successfully. Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e2ed60a4-7e20-491c-8a50-bd957423b400 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-07681ae7-0010-4a4f-bf9d-a3ab6fd1865e-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:48 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:48 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0 Apr 02 10:37:48 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:48 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" returned: 0 in 0.394s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-quobyte-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0" released by "delete_volume" :: held 0.890s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Created reservations ['2745e7ad-bb99-4a51-a9c7-67be4753b0b2', '67e23efd-449b-41d3-8cd0-bc4d4619e75a', '76ef613f-ce19-4b9d-901e-8c383dba0041', '3594b3ac-622c-4f34-be78-61bc6f37c440'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:37:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:37:48 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:37:48 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:37:49 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 02 10:37:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.434s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:37:49 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:37:49 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Deleted volume successfully. Apr 02 10:37:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-c5ebbc1a-634a-4e30-bae6-fdefb1de6fe2 tempest-SnapshotDependencyTests-1579021612 None] Lock "cinder-9f149801-f6f9-4f8c-b4f5-387a64fdf0b0-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:37:58 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=24,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=5 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:37:59 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=23,cinder:INSERT=9,cinder:DELETE=4,cinder:SELECT=23 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (346f12ac-6422-4fd8-bf66-771ca228f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e362cd-7abd-4a97-b0c1-5232a974d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e362cd-7abd-4a97-b0c1-5232a974d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990016473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06149fdb-c799-47b1-b8c7-46c43fe0ec8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:01Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e6bead-35b3-487a-a84d-2aa2a1e39a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e6bead-35b3-487a-a84d-2aa2a1e39a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2288deab-fb1e-44bb-80c2-e0d264ffb21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2288deab-fb1e-44bb-80c2-e0d264ffb21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06149fdb-c799-47b1-b8c7-46c43fe0ec8c', 'volume_name': 'volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2106999d-5692-42c4-abbc-bc79b408db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2106999d-5692-42c4-abbc-bc79b408db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08361214-6084-43cf-b5a3-858cd7928552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Volume 06149fdb-c799-47b1-b8c7-46c43fe0ec8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c', 'volume_size': 1} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990016473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06149fdb-c799-47b1-b8c7-46c43fe0ec8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:01Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Creating volume 06149fdb-c799-47b1-b8c7-46c43fe0ec8c {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:01 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:01 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c 1073741824 Apr 02 10:38:01 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (9072a1a3-45c9-46ac-99a0-64658693b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ea583b-29a1-4c92-936b-4a2815370c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ea583b-29a1-4c92-936b-4a2815370c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2040446297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3d1a9f-091c-410f-adc2-85128cfadeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4047bfdabfc24002b02cd188f78029e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='928899554e12440e852ed48808f3e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f16e62-6580-4d4c-8138-7737316faa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f16e62-6580-4d4c-8138-7737316faa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68ddbac-58d6-4cd2-8196-c6a9de50399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68ddbac-58d6-4cd2-8196-c6a9de50399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3d1a9f-091c-410f-adc2-85128cfadeec', 'volume_name': 'volume-4c3d1a9f-091c-410f-adc2-85128cfadeec', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ba3fca-b7da-4e6e-a741-33fbb04bd839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ba3fca-b7da-4e6e-a741-33fbb04bd839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dac97c-81c5-4bc8-a246-0afeafcbee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Volume 4c3d1a9f-091c-410f-adc2-85128cfadeec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3d1a9f-091c-410f-adc2-85128cfadeec', 'volume_size': 1} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (39ec4b20-ef24-4c63-b396-0a83bf9ce8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2707277-fb26-4aa1-b2f4-3bb7a70adda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2707277-fb26-4aa1-b2f4-3bb7a70adda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820853229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e33119-3abb-4994-84f5-955d2dd47a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654a50d3-d1de-420f-8d65-f324dd539dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654a50d3-d1de-420f-8d65-f324dd539dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c0eeb8-75e6-49f4-9102-259975a7e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c0eeb8-75e6-49f4-9102-259975a7e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e33119-3abb-4994-84f5-955d2dd47a57', 'volume_name': 'volume-45e33119-3abb-4994-84f5-955d2dd47a57', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c6de83-14d9-4adb-9086-d94aae272ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c6de83-14d9-4adb-9086-d94aae272ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81883f8f-e303-4a8e-9437-75c53250d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:01 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume 45e33119-3abb-4994-84f5-955d2dd47a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e33119-3abb-4994-84f5-955d2dd47a57', 'volume_size': 1} Apr 02 10:38:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (a08e4c5e-ce61-476a-86ae-6bf6c724c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e284bb-6cd1-4ebd-8f97-632cc5d425f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e284bb-6cd1-4ebd-8f97-632cc5d425f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1891766446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b64a0fa-e35b-46b1-9c4d-82ebf95294c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d1bac4-0f42-43ad-8726-55c882e1713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d1bac4-0f42-43ad-8726-55c882e1713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e2275c-fb34-4037-9599-0813a99bec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e2275c-fb34-4037-9599-0813a99bec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b64a0fa-e35b-46b1-9c4d-82ebf95294c3', 'volume_name': 'volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a69dc-0349-415b-9b8d-44edbd039dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a69dc-0349-415b-9b8d-44edbd039dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed47df41-8952-4e01-9fb6-1fb30f24fbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Volume 2b64a0fa-e35b-46b1-9c4d-82ebf95294c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3', 'volume_size': 1} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (bf654748-ee25-41e7-a1c2-fbf22ba00d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9123e38-59c9-4acc-bad4-98dc2ed3418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9123e38-59c9-4acc-bad4-98dc2ed3418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1713251789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77a68dd-a709-4a74-8918-344a06047ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a3c098-03ca-4335-b91d-1917633eadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a3c098-03ca-4335-b91d-1917633eadba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b8f61c-fcbc-436d-87d1-8e7d24947b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b8f61c-fcbc-436d-87d1-8e7d24947b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77a68dd-a709-4a74-8918-344a06047ea2', 'volume_name': 'volume-a77a68dd-a709-4a74-8918-344a06047ea2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbb2aae-806b-4553-9743-a67e3cf2e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbbb2aae-806b-4553-9743-a67e3cf2e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78ca08d-b91a-4b31-9e32-dd3fbd40e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Volume a77a68dd-a709-4a74-8918-344a06047ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77a68dd-a709-4a74-8918-344a06047ea2', 'volume_size': 1} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:02 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c 1073741824" returned: 0 in 0.728s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:02 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c Apr 02 10:38:02 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (6130798e-e10f-44c0-accf-50ce63b43347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f15f9-cfdf-4065-bf30-102bcbdbf877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344f15f9-cfdf-4065-bf30-102bcbdbf877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518107153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8aee6e-31fd-43da-aeda-c8c69f11d2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:03Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e7b589-8a3c-492a-bb8a-0b7d18eb66ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e7b589-8a3c-492a-bb8a-0b7d18eb66ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9486ad58-8962-4011-af2b-c0ba02409d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9486ad58-8962-4011-af2b-c0ba02409d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8aee6e-31fd-43da-aeda-c8c69f11d2ca', 'volume_name': 'volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038ca719-a084-4083-9ad6-c46a4b1e81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038ca719-a084-4083-9ad6-c46a4b1e81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c7a06c-0a50-4be7-9e8e-70121748a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Volume 6e8aee6e-31fd-43da-aeda-c8c69f11d2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca', 'volume_size': 1} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (094e6744-8962-4d49-8a37-c65757497c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a205b6-798b-4886-a714-fafdf09eacf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a205b6-798b-4886-a714-fafdf09eacf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308224711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34571d05-c7e9-4a04-b90f-25b1aa168213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:03Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe4124e-c2f3-4203-80ba-4655865dca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe4124e-c2f3-4203-80ba-4655865dca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9361d2-766f-4ba6-a5b6-b84d1663e2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9361d2-766f-4ba6-a5b6-b84d1663e2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34571d05-c7e9-4a04-b90f-25b1aa168213', 'volume_name': 'volume-34571d05-c7e9-4a04-b90f-25b1aa168213', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224b238c-f722-478a-b359-1f73b17688ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224b238c-f722-478a-b359-1f73b17688ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c984d2a5-33d5-4e94-9c27-7fd7fa25b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Volume 34571d05-c7e9-4a04-b90f-25b1aa168213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34571d05-c7e9-4a04-b90f-25b1aa168213', 'volume_size': 1} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:02 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c" returned: 0 in 0.521s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2040446297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3d1a9f-091c-410f-adc2-85128cfadeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4047bfdabfc24002b02cd188f78029e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='928899554e12440e852ed48808f3e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Creating volume 4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08361214-6084-43cf-b5a3-858cd7928552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec 1073741824 Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7adc659-eff1-4e92-bf9e-cf0ee3295198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:02 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Volume volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c (06149fdb-c799-47b1-b8c7-46c43fe0ec8c): created successfully Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7adc659-eff1-4e92-bf9e-cf0ee3295198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:02 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (346f12ac-6422-4fd8-bf66-771ca228f968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:02 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d9b009b4-c6c7-4a91-a72c-21ef8cf47f5c tempest-CreateVolumesFromImageTest-1649528172 None] Created volume successfully. Apr 02 10:38:03 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec 1073741824" returned: 0 in 0.585s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:03 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:03 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:03 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.460s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820853229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e33119-3abb-4994-84f5-955d2dd47a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Creating volume 45e33119-3abb-4994-84f5-955d2dd47a57 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:03 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dac97c-81c5-4bc8-a246-0afeafcbee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3d1a9f-091c-410f-adc2-85128cfadeec', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753bcd34-555c-4c70-a004-cd0e71bdc923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:03 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 1073741824 Apr 02 10:38:03 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:03 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Volume volume-4c3d1a9f-091c-410f-adc2-85128cfadeec (4c3d1a9f-091c-410f-adc2-85128cfadeec): created successfully Apr 02 10:38:03 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753bcd34-555c-4c70-a004-cd0e71bdc923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:04 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (9072a1a3-45c9-46ac-99a0-64658693b52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:04 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-84516a3b-c227-4f78-8bfb-32bc9115c421 tempest-VolumeDependencyTests-1705136307 None] Created volume successfully. Apr 02 10:38:04 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 1073741824" returned: 0 in 0.573s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:04 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:04 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 Apr 02 10:38:04 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:05 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1891766446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b64a0fa-e35b-46b1-9c4d-82ebf95294c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Creating volume 2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:05 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:05 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 1073741824 Apr 02 10:38:05 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81883f8f-e303-4a8e-9437-75c53250d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e33119-3abb-4994-84f5-955d2dd47a57', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3de4f3-03ac-4e39-9316-6dcf6ffe5ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:05 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume volume-45e33119-3abb-4994-84f5-955d2dd47a57 (45e33119-3abb-4994-84f5-955d2dd47a57): created successfully Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3de4f3-03ac-4e39-9316-6dcf6ffe5ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (39ec4b20-ef24-4c63-b396-0a83bf9ce8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:05 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-70dd6810-460e-41a3-a815-16e45173283c tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created volume successfully. Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:05 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 1073741824" returned: 0 in 0.555s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:05 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:05 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 Apr 02 10:38:05 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:06 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3" returned: 0 in 0.491s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1713251789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77a68dd-a709-4a74-8918-344a06047ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:02Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Creating volume a77a68dd-a709-4a74-8918-344a06047ea2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:06 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed47df41-8952-4e01-9fb6-1fb30f24fbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e414f6-1cf4-4470-af3d-ddfa2508130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Volume volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 (2b64a0fa-e35b-46b1-9c4d-82ebf95294c3): created successfully Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e414f6-1cf4-4470-af3d-ddfa2508130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 1073741824 Apr 02 10:38:06 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (a08e4c5e-ce61-476a-86ae-6bf6c724c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:06 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-65bc96a5-98a1-4ed1-8b7b-36547a57f565 tempest-CreateVolumesFromImageTest-1649528172 None] Created volume successfully. Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (25200e1e-6d90-4d45-ae18-ec7df6a961c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f1dc5b-8324-45c4-b560-72e13418bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f1dc5b-8324-45c4-b560-72e13418bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635916561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a807eaba-6262-48c5-8053-b731237142f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:06Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0498ab-a2b2-4c60-b1f9-95b4aa0c504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0498ab-a2b2-4c60-b1f9-95b4aa0c504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fad506-c610-4037-a79e-ad2b0697bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fad506-c610-4037-a79e-ad2b0697bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a807eaba-6262-48c5-8053-b731237142f7', 'volume_name': 'volume-a807eaba-6262-48c5-8053-b731237142f7', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2491f7d-8f31-465d-b072-9bdd1eee2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2491f7d-8f31-465d-b072-9bdd1eee2e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aa38d3-8ba7-4618-b2d6-2a85a3bffc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume a807eaba-6262-48c5-8053-b731237142f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a807eaba-6262-48c5-8053-b731237142f7', 'volume_size': 1} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (47357894-4199-43b2-8e9a-5868c53c6a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a273685-d90d-4c0c-8ae0-aa9ab95df4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a273685-d90d-4c0c-8ae0-aa9ab95df4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064464327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e98bf9-4f0d-4473-bdab-04995ce9c07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:06Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f9b986-adea-4243-9087-81ed19f26920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f9b986-adea-4243-9087-81ed19f26920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec70377c-e70b-4ad2-be20-94769a22a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec70377c-e70b-4ad2-be20-94769a22a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e98bf9-4f0d-4473-bdab-04995ce9c07e', 'volume_name': 'volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c058051-c5bc-4225-b35a-46a749a4dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c058051-c5bc-4225-b35a-46a749a4dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d28ba0a-959e-4e1a-b3a8-390c39501f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume d7e98bf9-4f0d-4473-bdab-04995ce9c07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e', 'volume_size': 1} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (5f95d273-6675-4123-9dfb-53163db09c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c916ba09-fe95-4569-b399-ecff05baba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c916ba09-fe95-4569-b399-ecff05baba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220862734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b516d025-532b-4936-ae50-6e6ef0e18b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:07Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81683932-e8ae-4e1b-8edc-51fd99b1e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81683932-e8ae-4e1b-8edc-51fd99b1e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9490eb2-93eb-4965-a29a-b37b0010650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9490eb2-93eb-4965-a29a-b37b0010650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b516d025-532b-4936-ae50-6e6ef0e18b06', 'volume_name': 'volume-b516d025-532b-4936-ae50-6e6ef0e18b06', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365bcf5f-dcfd-4e91-bf6e-36d8ec0920b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365bcf5f-dcfd-4e91-bf6e-36d8ec0920b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6592db46-1307-4670-b321-f307e94babab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:06 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume b516d025-532b-4936-ae50-6e6ef0e18b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b516d025-532b-4936-ae50-6e6ef0e18b06', 'volume_size': 1} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 1073741824" returned: 0 in 0.693s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:06 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:06 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 Apr 02 10:38:06 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (a24501cb-9583-4f82-a0f6-95ca2db65352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7838c5-8dc9-4ad5-b2e2-4f06a93815f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7838c5-8dc9-4ad5-b2e2-4f06a93815f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922026866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a97e32-19b1-456c-baa1-b44f29b57b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:07Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1518e8a4-6273-4a4a-a65f-32ed3c5b363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1518e8a4-6273-4a4a-a65f-32ed3c5b363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4e93de-a316-47df-81de-e4e4983c2ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4e93de-a316-47df-81de-e4e4983c2ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a97e32-19b1-456c-baa1-b44f29b57b88', 'volume_name': 'volume-52a97e32-19b1-456c-baa1-b44f29b57b88', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f513b75c-5964-4a52-ac7e-d9b823b4b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f513b75c-5964-4a52-ac7e-d9b823b4b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8104e60b-0815-44ff-aa2a-8b1354610f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume 52a97e32-19b1-456c-baa1-b44f29b57b88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a97e32-19b1-456c-baa1-b44f29b57b88', 'volume_size': 1} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (bc141e52-4ccf-4885-bca7-ae97f59cfc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9232e912-86e1-4dda-841d-92a60b8c3cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9232e912-86e1-4dda-841d-92a60b8c3cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218380071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85df6b5-58cf-4e87-a0cb-b51ba7875ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:07Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee868e26-a273-4887-b1e5-6d13b426cc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee868e26-a273-4887-b1e5-6d13b426cc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7703d13-6d92-49d4-951a-e08e54a33743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7703d13-6d92-49d4-951a-e08e54a33743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85df6b5-58cf-4e87-a0cb-b51ba7875ad3', 'volume_name': 'volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7caa88-2ce4-4525-9739-b8f8098046f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f7caa88-2ce4-4525-9739-b8f8098046f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba365b4-b583-45e1-bdcd-9993524d486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume b85df6b5-58cf-4e87-a0cb-b51ba7875ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3', 'volume_size': 1} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:07 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2" returned: 0 in 0.605s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.867s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518107153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8aee6e-31fd-43da-aeda-c8c69f11d2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:03Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Creating volume 6e8aee6e-31fd-43da-aeda-c8c69f11d2ca {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:07 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78ca08d-b91a-4b31-9e32-dd3fbd40e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77a68dd-a709-4a74-8918-344a06047ea2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f821610-3a80-40f6-aa7f-17a7412133e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:07 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca 1073741824 Apr 02 10:38:07 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:07 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Volume volume-a77a68dd-a709-4a74-8918-344a06047ea2 (a77a68dd-a709-4a74-8918-344a06047ea2): created successfully Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f821610-3a80-40f6-aa7f-17a7412133e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:07 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (bf654748-ee25-41e7-a1c2-fbf22ba00d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:07 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-15cd027d-60fe-482a-815b-18dd1d12aabc tempest-CreateVolumesFromImageTest-1649528172 None] Created volume successfully. Apr 02 10:38:08 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca 1073741824" returned: 0 in 0.598s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:08 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca Apr 02 10:38:08 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:08 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca" returned: 0 in 0.468s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.826s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-308224711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34571d05-c7e9-4a04-b90f-25b1aa168213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ea3bed04db4d25964b96924a883f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:03Z,use_quota=True,user_id='29521d2fa6d2431480d85c970f1854f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Creating volume 34571d05-c7e9-4a04-b90f-25b1aa168213 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:08 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c7a06c-0a50-4be7-9e8e-70121748a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:08 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 1073741824 Apr 02 10:38:08 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eefa638-fc72-4195-822a-6c7ee3650a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:08 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Volume volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca (6e8aee6e-31fd-43da-aeda-c8c69f11d2ca): created successfully Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eefa638-fc72-4195-822a-6c7ee3650a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:08 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (6130798e-e10f-44c0-accf-50ce63b43347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:08 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-88f467f9-2a6b-433b-aaaa-41311645c4a8 tempest-CreateVolumesFromImageTest-1649528172 None] Created volume successfully. Apr 02 10:38:09 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 1073741824" returned: 0 in 0.500s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:09 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 Apr 02 10:38:09 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:09 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213" returned: 0 in 0.441s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.399s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c984d2a5-33d5-4e94-9c27-7fd7fa25b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34571d05-c7e9-4a04-b90f-25b1aa168213', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb40a7f0-dbe1-4872-b47e-6fccc8eac735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Creating offline snapshot 12ab8602-3181-40b9-8bf9-79bf7ae1d816 of volume 4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:38:09 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Volume volume-34571d05-c7e9-4a04-b90f-25b1aa168213 (34571d05-c7e9-4a04-b90f-25b1aa168213): created successfully Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb40a7f0-dbe1-4872-b47e-6fccc8eac735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Flow 'volume_create_manager' (094e6744-8962-4d49-8a37-c65757497c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2ece8a-702e-4e5a-b4f1-5f632bc71139]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:09 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:09 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-963cf240-fe26-4810-8dcb-8dd7da925d2a tempest-CreateVolumesFromImageTest-1649528172 None] Created volume successfully. Apr 02 10:38:09 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:09 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:10 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.504s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:10 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 1G Apr 02 10:38:10 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-34571d05-c7e9-4a04-b90f-25b1aa168213-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-34571d05-c7e9-4a04-b90f-25b1aa168213-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-quobyte-34571d05-c7e9-4a04-b90f-25b1aa168213" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-34571d05-c7e9-4a04-b90f-25b1aa168213" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74df63c-2454-4362-ad01-fc9d3cc823bc]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:10 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 Apr 02 10:38:10 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:10 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 1G" returned: 0 in 0.563s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3d1a9f-091c-410f-adc2-85128cfadeec -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:10 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3d1a9f-091c-410f-adc2-85128cfadeec -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 Apr 02 10:38:10 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:10 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213" returned: 0 in 0.500s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:10 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:10 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213 Apr 02 10:38:10 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:11 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3d1a9f-091c-410f-adc2-85128cfadeec -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816" returned: 0 in 0.405s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:11 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 is being set with open permissions: ugo+rw Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:11 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 Apr 02 10:38:11 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:11 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-34571d05-c7e9-4a04-b90f-25b1aa168213" returned: 0 in 0.494s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-34571d05-c7e9-4a04-b90f-25b1aa168213" released by "delete_volume" :: held 1.018s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Created reservations ['25b1c95a-aa93-4a65-8c6c-45d57d9e7a1b', '1127930f-b61b-4fa7-8117-8afb259fa66d', '12507627-04c2-4b53-b090-50fb1cfbd5e9', 'fe920cbc-f404-4f01-94bd-96f75f105d3c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:11 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:11 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:11 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816" returned: 0 in 0.542s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:11 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info Apr 02 10:38:11 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:11 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.418s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:11 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Deleted volume successfully. Apr 02 10:38:11 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ebeb6bf9-049b-4067-9662-2fb311143c48 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-34571d05-c7e9-4a04-b90f-25b1aa168213-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:12 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info" returned: 0 in 0.472s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:12 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info is being set with open permissions: ugo+rw Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:12 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info Apr 02 10:38:12 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-quobyte-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d746a51b-4cc9-4b86-bdb7-a424c3bf9efb]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:12 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.info" returned: 0 in 0.550s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.309s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-635916561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a807eaba-6262-48c5-8053-b731237142f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:06Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Creating volume a807eaba-6262-48c5-8053-b731237142f7 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:12 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:12 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:12 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca Apr 02 10:38:12 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:12 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 1073741824 Apr 02 10:38:12 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:12 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1c104631-d3c8-4a55-ab0f-04e10c1073ea tempest-VolumeDependencyTests-1705136307 None] Create snapshot completed successfully Apr 02 10:38:13 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca" returned: 0 in 0.565s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:13 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca Apr 02 10:38:13 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:13 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 1073741824" returned: 0 in 0.672s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:13 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 Apr 02 10:38:13 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:13 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca" returned: 0 in 0.541s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca" released by "delete_volume" :: held 1.166s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Created reservations ['95948564-1871-4e14-97da-71eedaa528a0', 'ad7fd0b7-e71c-45bf-88d8-4b2703253fc8', 'a2f015e6-ec7b-4c4c-9502-86a52793e4d2', '0c296d84-9595-4cb4-92dd-74bc6784cefd'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:13 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:13 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:13 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (c70b365c-6426-496c-9fd0-454e3fe4661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e68109b-bb33-4957-9e91-fd55d686bb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e68109b-bb33-4957-9e91-fd55d686bb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1198981256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842b83e9-bcf8-4939-a6d3-a50b1fa9cc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4047bfdabfc24002b02cd188f78029e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12ab8602-3181-40b9-8bf9-79bf7ae1d816,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:14Z,use_quota=True,user_id='928899554e12440e852ed48808f3e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789bbaa1-73e2-428e-93c8-07c863f48225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789bbaa1-73e2-428e-93c8-07c863f48225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4201792-ec4b-4981-9dbc-3db3994fa701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4201792-ec4b-4981-9dbc-3db3994fa701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '842b83e9-bcf8-4939-a6d3-a50b1fa9cc26', 'volume_name': 'volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26', 'volume_size': 1, 'snapshot_id': '12ab8602-3181-40b9-8bf9-79bf7ae1d816'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cff8092-410a-451b-81ce-926155fc1694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cff8092-410a-451b-81ce-926155fc1694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0f6b37-224b-41ee-a7a9-1a5473fb40f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Volume 842b83e9-bcf8-4939-a6d3-a50b1fa9cc26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26', 'volume_size': 1, 'snapshot_id': '12ab8602-3181-40b9-8bf9-79bf7ae1d816'} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:14 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7" returned: 0 in 0.653s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.440s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2064464327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e98bf9-4f0d-4473-bdab-04995ce9c07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:06Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Creating volume d7e98bf9-4f0d-4473-bdab-04995ce9c07e {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:14 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1aa38d3-8ba7-4618-b2d6-2a85a3bffc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a807eaba-6262-48c5-8053-b731237142f7', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b7c070-c21e-4d82-963f-1689fdfafbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume volume-a807eaba-6262-48c5-8053-b731237142f7 (a807eaba-6262-48c5-8053-b731237142f7): created successfully Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b7c070-c21e-4d82-963f-1689fdfafbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e 1073741824 Apr 02 10:38:14 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (25200e1e-6d90-4d45-ae18-ec7df6a961c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b888e866-301a-43c6-bb02-c23c72784254 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created volume successfully. Apr 02 10:38:14 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.528s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:14 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Deleted volume successfully. Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-02b48e24-3c90-4269-830c-d13b9890afad tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-6e8aee6e-31fd-43da-aeda-c8c69f11d2ca-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Flow 'volume_create_manager' (eb9fc036-4431-4ddf-a004-2d78c8281b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44b39d1-364f-4cf4-9689-7290c5678525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44b39d1-364f-4cf4-9689-7290c5678525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1181642000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eccffd8-b018-4210-96f5-a5d5a5e1eaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359ef0a8726b4df4a823c639d8f5afa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:15Z,use_quota=True,user_id='b954eb43e1574705b684c9d5f921c914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071af8d0-5a40-40f8-9340-1764f58897b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071af8d0-5a40-40f8-9340-1764f58897b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c0f986-08d1-455e-a18e-67bd247467bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c0f986-08d1-455e-a18e-67bd247467bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eccffd8-b018-4210-96f5-a5d5a5e1eaeb', 'volume_name': 'volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2ef598-74bc-4f3e-a558-321c1003ae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2ef598-74bc-4f3e-a558-321c1003ae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0586cc-3c59-41b4-8115-2170b6940be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:14 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Volume 4eccffd8-b018-4210-96f5-a5d5a5e1eaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb', 'volume_size': 1} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-a77a68dd-a709-4a74-8918-344a06047ea2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-a77a68dd-a709-4a74-8918-344a06047ea2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:14 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e 1073741824" returned: 0 in 0.660s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-quobyte-a77a68dd-a709-4a74-8918-344a06047ea2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-a77a68dd-a709-4a74-8918-344a06047ea2" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91fea72-881a-4515-b6ee-eaef15bf0e2f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:14 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:14 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e Apr 02 10:38:14 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:14 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 Apr 02 10:38:14 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:15 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e" returned: 0 in 0.419s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.353s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-220862734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b516d025-532b-4936-ae50-6e6ef0e18b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:07Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Creating volume b516d025-532b-4936-ae50-6e6ef0e18b06 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:15 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d28ba0a-959e-4e1a-b3a8-390c39501f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83976b93-4148-4144-a911-a0889bf50add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:15 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 1073741824 Apr 02 10:38:15 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:15 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e (d7e98bf9-4f0d-4473-bdab-04995ce9c07e): created successfully Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83976b93-4148-4144-a911-a0889bf50add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:15 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (47357894-4199-43b2-8e9a-5868c53c6a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2" returned: 0 in 0.464s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:15 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-99b916d9-b186-4ee2-abc6-734c7b1f6c90 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created volume successfully. Apr 02 10:38:15 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2 Apr 02 10:38:15 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:15 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a77a68dd-a709-4a74-8918-344a06047ea2" returned: 0 in 0.420s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-a77a68dd-a709-4a74-8918-344a06047ea2" released by "delete_volume" :: held 0.914s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:15 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 1073741824" returned: 0 in 0.501s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Created reservations ['d1a87a72-7a7b-453e-aad1-c5aa29456bcc', '637b6ca4-4584-43b1-82c6-ec33c2bfeca6', '345aa69d-74c2-46e9-815a-ac56a1b045ea', 'f0b55f87-8dc5-4628-aceb-1da124831ce6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:15 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 Apr 02 10:38:15 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:15 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:15 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-quobyte-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61632e2-47ef-464f-8037-12f0e1c8db3b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:15 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:15 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 Apr 02 10:38:15 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:16 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06" returned: 0 in 0.431s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.991s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922026866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a97e32-19b1-456c-baa1-b44f29b57b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:07Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Creating volume 52a97e32-19b1-456c-baa1-b44f29b57b88 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:16 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6592db46-1307-4670-b321-f307e94babab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b516d025-532b-4936-ae50-6e6ef0e18b06', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227cbf31-84e4-4492-80fd-f62b08ecbb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:16 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 1073741824 Apr 02 10:38:16 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:16 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.419s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:16 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume volume-b516d025-532b-4936-ae50-6e6ef0e18b06 (b516d025-532b-4936-ae50-6e6ef0e18b06): created successfully Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227cbf31-84e4-4492-80fd-f62b08ecbb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (5f95d273-6675-4123-9dfb-53163db09c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Deleted volume successfully. Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-ea7eaac7-896e-4114-a064-3f89d7290fa4 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-a77a68dd-a709-4a74-8918-344a06047ea2-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:16 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f72ccd74-c61c-4e1c-82b1-1b514b6ac686 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created volume successfully. Apr 02 10:38:16 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3" returned: 0 in 0.486s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:16 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3 Apr 02 10:38:16 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:16 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 1073741824" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:16 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 Apr 02 10:38:16 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:16 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3" returned: 0 in 0.426s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3" released by "delete_volume" :: held 0.933s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Created reservations ['7e2b947d-9af1-45e2-a16f-c828e7d07a3d', 'fa5d332c-402e-42e8-9e2a-b6b9c9b0cc5c', '09197bad-6fc3-41cf-9ebf-ae6f0d4ab61a', '26ad94cb-d24f-447a-b8f1-ecb90f18d3c8'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:16 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:16 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-06149fdb-c799-47b1-b8c7-46c43fe0ec8c-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:16 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-06149fdb-c799-47b1-b8c7-46c43fe0ec8c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "cinder-quobyte-06149fdb-c799-47b1-b8c7-46c43fe0ec8c" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-06149fdb-c799-47b1-b8c7-46c43fe0ec8c" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebbfe87-7e2e-4288-be82-d53c36b2fba4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:17 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c Apr 02 10:38:17 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:17 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88" returned: 0 in 0.447s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.796s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218380071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85df6b5-58cf-4e87-a0cb-b51ba7875ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2154205461ca41ea8db2fd371196c63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:07Z,use_quota=True,user_id='6a5f3be2893d4c32a1a164ebcef9dbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Creating volume b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:17 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8104e60b-0815-44ff-aa2a-8b1354610f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a97e32-19b1-456c-baa1-b44f29b57b88', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:17 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 1073741824 Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f845504-71e8-4c0d-a351-c5eabda18152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:17 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:17 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume volume-52a97e32-19b1-456c-baa1-b44f29b57b88 (52a97e32-19b1-456c-baa1-b44f29b57b88): created successfully Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f845504-71e8-4c0d-a351-c5eabda18152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (a24501cb-9583-4f82-a0f6-95ca2db65352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-19e4b56b-b259-4ea1-818c-75148b1bb418 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created volume successfully. Apr 02 10:38:17 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.432s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:17 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Deleted volume successfully. Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1029c5cc-5c26-435b-b067-9473007ff0d3 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-2b64a0fa-e35b-46b1-9c4d-82ebf95294c3-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:17 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c" returned: 0 in 0.470s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:17 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c Apr 02 10:38:17 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:17 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 1073741824" returned: 0 in 0.485s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:17 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 Apr 02 10:38:17 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:17 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-06149fdb-c799-47b1-b8c7-46c43fe0ec8c" returned: 0 in 0.418s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-quobyte-06149fdb-c799-47b1-b8c7-46c43fe0ec8c" released by "delete_volume" :: held 0.945s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:17 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Created reservations ['fa6fcae4-1f8c-4046-909d-62facbd7c697', '3f404e8c-f073-410a-bbf0-e07e64cb92b2', '2305d0cd-644c-400f-8d16-d2e30839049d', '287817a4-6f82-4612-8da3-05c2ce09cce5'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:18 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:18 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:18 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.050s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-12ab8602-3181-40b9-8bf9-79bf7ae1d816-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba365b4-b583-45e1-bdcd-9993524d486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac04d25e-b188-463b-b605-c1bb909bd686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:18 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Volume volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 (b85df6b5-58cf-4e87-a0cb-b51ba7875ad3): created successfully Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac04d25e-b188-463b-b605-c1bb909bd686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Flow 'volume_create_manager' (bc141e52-4ccf-4885-bca7-ae97f59cfc6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-12ab8602-3181-40b9-8bf9-79bf7ae1d816-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Creating volume 842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 from snapshot 12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-da4dc47e-a05b-4074-b5d6-33082e743660 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created volume successfully. Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] snapshot: 12ab8602-3181-40b9-8bf9-79bf7ae1d816, volume: 842b83e9-bcf8-4939-a6d3-a50b1fa9cc26, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ac034-d8b4-4fbe-9259-22a7ee68bee7]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:18 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 Apr 02 10:38:18 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:18 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.440s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:18 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Deleted volume successfully. Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2b159c4b-7a4a-4571-80cb-1ca1a688bbb5 tempest-CreateVolumesFromImageTest-1649528172 None] Lock "cinder-06149fdb-c799-47b1-b8c7-46c43fe0ec8c-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:18 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816" returned: 0 in 0.578s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d1a9f-091c-410f-adc2-85128cfadeec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f42bc4c-90d7-434a-bbc9-2eb2f99fb376]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:18 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:18 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:18 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-quobyte-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05a88e4-c219-4f1d-aee8-bbfe9b33791e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:19 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 Apr 02 10:38:19 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:19 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.594s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:19 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 Apr 02 10:38:19 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:19 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3" returned: 0 in 0.606s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:19 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:19 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3 Apr 02 10:38:19 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (fe43e120-c549-4692-881f-d18a6b9d0352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2fe95b-b6a7-4435-8f54-f6fbe0f74236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2fe95b-b6a7-4435-8f54-f6fbe0f74236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442003622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468bf296-8f57-434f-9b6d-635eeed46dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:20Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06b22fa-59b3-45dc-b7b7-c4032c8293a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06b22fa-59b3-45dc-b7b7-c4032c8293a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbd372c-e3a9-4b6c-836d-87f205e4a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbd372c-e3a9-4b6c-836d-87f205e4a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468bf296-8f57-434f-9b6d-635eeed46dbb', 'volume_name': 'volume-468bf296-8f57-434f-9b6d-635eeed46dbb', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edffa78b-192a-4211-9d8f-9898fa71d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edffa78b-192a-4211-9d8f-9898fa71d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f4ad6e-8978-4014-91cf-002084d8c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:20 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume 468bf296-8f57-434f-9b6d-635eeed46dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468bf296-8f57-434f-9b6d-635eeed46dbb', 'volume_size': 1} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:20 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3" returned: 0 in 0.790s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3" released by "delete_volume" :: held 1.424s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created reservations ['26efb179-94e5-4523-8077-3e4cc7dbc5b5', '81b3a96d-4336-4a5c-9969-c9eceea8e9d0', 'f4f2d240-6ec9-4cf1-89cb-ba6cea838cbe', '2ecfadb5-42ce-4804-8167-fe9cbe9258b1'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:20 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:20 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:20 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-52a97e32-19b1-456c-baa1-b44f29b57b88-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-52a97e32-19b1-456c-baa1-b44f29b57b88-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:21 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-quobyte-52a97e32-19b1-456c-baa1-b44f29b57b88" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.774s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:21 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Deleted volume successfully. Apr 02 10:38:21 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-52a97e32-19b1-456c-baa1-b44f29b57b88" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" returned: 0 in 2.226s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9398da1-798d-40db-885b-e5301e8e182b]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc989aa4-94b4-4a43-bfd6-767108e3d3c9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:21 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e1edddc7-6581-4c9b-9d43-a3e2b387867b tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-b85df6b5-58cf-4e87-a0cb-b51ba7875ad3-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:21 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 Apr 02 10:38:21 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:21 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:21 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:22 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88" returned: 0 in 0.462s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:22 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88 Apr 02 10:38:22 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:22 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.580s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:38:22 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Converted 1024.00 MB image at 459.69 MB/s Apr 02 10:38:22 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 is being set with open permissions: ugo+rw Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:22 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 Apr 02 10:38:22 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:22 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-52a97e32-19b1-456c-baa1-b44f29b57b88" returned: 0 in 0.434s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-52a97e32-19b1-456c-baa1-b44f29b57b88" released by "delete_volume" :: held 0.917s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created reservations ['b96c33ea-0d86-45fb-aecf-f6f4cb5381bd', '6e047677-5379-4cda-8dda-9bb8dd608c0e', 'd4934f98-ce42-4947-8bce-faf5548ec333', '3c0c0947-7c20-4d6e-bf30-21dfb46b1b03'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:22 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:22 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:22 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-b516d025-532b-4936-ae50-6e6ef0e18b06-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" returned: 0 in 0.428s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-b516d025-532b-4936-ae50-6e6ef0e18b06-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" released by "_copy_volume_from_snapshot" :: held 4.474s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-12ab8602-3181-40b9-8bf9-79bf7ae1d816-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" released by "_create_volume_from_snapshot" :: held 4.496s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.531s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.990s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1181642000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eccffd8-b018-4210-96f5-a5d5a5e1eaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359ef0a8726b4df4a823c639d8f5afa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:15Z,use_quota=True,user_id='b954eb43e1574705b684c9d5f921c914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Creating volume 4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:22 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:22 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb 1073741824 Apr 02 10:38:22 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0f6b37-224b-41ee-a7a9-1a5473fb40f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26', 'volume_size': 1, 'snapshot_id': '12ab8602-3181-40b9-8bf9-79bf7ae1d816'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7983fd1d-1602-4ca4-b756-d8ff1ad537ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-quobyte-b516d025-532b-4936-ae50-6e6ef0e18b06" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:22 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Volume volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 (842b83e9-bcf8-4939-a6d3-a50b1fa9cc26): created successfully Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7983fd1d-1602-4ca4-b756-d8ff1ad537ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (c70b365c-6426-496c-9fd0-454e3fe4661f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-b516d025-532b-4936-ae50-6e6ef0e18b06" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:22 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-97baa949-38a6-4f6d-9dcd-bb98ea9dc9b8 tempest-VolumeDependencyTests-1705136307 None] Created volume successfully. Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb7f95d-cd73-434c-ad2d-d07ae33f1e1e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:22 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:22 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 Apr 02 10:38:22 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:23 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.441s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Deleted volume successfully. Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-03610dd3-a33e-4b25-975a-f15d33982479 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-52a97e32-19b1-456c-baa1-b44f29b57b88-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:23 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb 1073741824" returned: 0 in 0.493s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:23 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:23 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:23 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06" returned: 0 in 0.466s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:23 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06 Apr 02 10:38:23 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:23 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.398s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.354s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442003622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468bf296-8f57-434f-9b6d-635eeed46dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:20Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating volume 468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:23 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-12ab8602-3181-40b9-8bf9-79bf7ae1d816-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0586cc-3c59-41b4-8115-2170b6940be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c28b9d-de9b-4fc3-9c2d-080a6efcc207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:23 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Volume volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb (4eccffd8-b018-4210-96f5-a5d5a5e1eaeb): created successfully Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c28b9d-de9b-4fc3-9c2d-080a6efcc207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:23 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb 1073741824 Apr 02 10:38:23 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Flow 'volume_create_manager' (eb9fc036-4431-4ddf-a004-2d78c8281b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:23 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:23 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-047427bf-0fe1-4ac8-bb56-6ecb5bc830b2 tempest-SnapshotDependencyTests-648399858 None] Created volume successfully. Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-12ab8602-3181-40b9-8bf9-79bf7ae1d816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-4c3d1a9f-091c-410f-adc2-85128cfadeec" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-b516d025-532b-4936-ae50-6e6ef0e18b06" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-b516d025-532b-4936-ae50-6e6ef0e18b06" released by "delete_volume" :: held 0.926s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-4c3d1a9f-091c-410f-adc2-85128cfadeec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-12ab8602-3181-40b9-8bf9-79bf7ae1d816" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created reservations ['c019c543-245a-4243-a3a8-48f136ced7ba', '3e457960-bec5-497a-9eca-4ca2e3e2ed62', 'ac5a4b88-9379-41e5-a66f-7a2a7d1fefdc', '349a1096-4903-4095-bf8c-37d804b42622'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-12ab8602-3181-40b9-8bf9-79bf7ae1d816" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Deleting offline snapshot 12ab8602-3181-40b9-8bf9-79bf7ae1d816 of volume 4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] snapshot_file for this snap is: volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c6e6c3-48a0-4e4c-bf58-29ae96a64740]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:23 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:23 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:23 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:23 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 Apr 02 10:38:23 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:24 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb 1073741824" returned: 0 in 0.505s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:24 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb Apr 02 10:38:24 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:24 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.451s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Deleted volume successfully. Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-54b471d5-b5b1-458f-aae4-c75780b99f28 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-b516d025-532b-4936-ae50-6e6ef0e18b06-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:24 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816" returned: 0 in 0.519s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d1a9f-091c-410f-adc2-85128cfadeec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03242150-6641-4b42-847b-677ece4f39d0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:24 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:24 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:24 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb" returned: 0 in 0.419s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.186s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Creating offline snapshot 9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 of volume 4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f4ad6e-8978-4014-91cf-002084d8c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468bf296-8f57-434f-9b6d-635eeed46dbb', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f179a88a-f46e-4c3b-a525-ed66e0c86e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f902a2e1-5bcb-4f06-86e7-9206384192ee]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:24 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume volume-468bf296-8f57-434f-9b6d-635eeed46dbb (468bf296-8f57-434f-9b6d-635eeed46dbb): created successfully Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f179a88a-f46e-4c3b-a525-ed66e0c86e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (fe43e120-c549-4692-881f-d18a6b9d0352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:24 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-28e73f86-c991-4156-b274-43fa6db9fd1a tempest-CreateVolumesFromSnapshotTest-654744706 None] Created volume successfully. Apr 02 10:38:24 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:24 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:24 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:24 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 Apr 02 10:38:24 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-d7e98bf9-4f0d-4473-bdab-04995ce9c07e-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-d7e98bf9-4f0d-4473-bdab-04995ce9c07e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-quobyte-d7e98bf9-4f0d-4473-bdab-04995ce9c07e" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-d7e98bf9-4f0d-4473-bdab-04995ce9c07e" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71e887-133e-4a42-a512-b216510c7fc0]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:24 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:24 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e Apr 02 10:38:24 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:25 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.483s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:25 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 1G Apr 02 10:38:25 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:25 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816" returned: 0 in 0.444s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:25 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816 Apr 02 10:38:25 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:25 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e" returned: 0 in 0.463s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:25 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e Apr 02 10:38:25 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:25 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 1G" returned: 0 in 0.506s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:25 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec.12ab8602-3181-40b9-8bf9-79bf7ae1d816" returned: 0 in 0.418s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:25 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 Apr 02 10:38:25 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-12ab8602-3181-40b9-8bf9-79bf7ae1d816" released by "_delete_snapshot" :: held 1.920s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-4c3d1a9f-091c-410f-adc2-85128cfadeec" released by "delete_snapshot" :: held 1.966s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Created reservations ['43a6ca9e-f0ae-4bd6-a037-6693e576cbef', '1889243d-d779-434f-9c22-f2f86cc68d59', '66c64de7-c242-4b43-b03a-a13b69e95ef9', '00e02f82-c527-48bd-b9a6-5effb0ec09d4'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:25 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Delete snapshot completed successfully. Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9f5720b4-6ba6-4854-8621-61cb4c2a4c62 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-12ab8602-3181-40b9-8bf9-79bf7ae1d816-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:25 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-d7e98bf9-4f0d-4473-bdab-04995ce9c07e" returned: 0 in 0.425s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-d7e98bf9-4f0d-4473-bdab-04995ce9c07e" released by "delete_volume" :: held 0.911s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created reservations ['57802dc7-2780-4ec2-8724-54f850ab903d', 'bc19489d-f538-4de3-bc44-c629439c47b7', '8fe04ce2-1a7a-4e88-938a-07a7250411c7', '05a9e9b2-03b0-41ab-bfee-72960db53ac0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:25 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:25 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-a807eaba-6262-48c5-8053-b731237142f7-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-a807eaba-6262-48c5-8053-b731237142f7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-quobyte-a807eaba-6262-48c5-8053-b731237142f7" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-a807eaba-6262-48c5-8053-b731237142f7" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb481f79-320c-454b-ba19-9c46441f1f5f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:25 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" returned: 0 in 0.496s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:26 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 is being set with open permissions: ugo+rw Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 Apr 02 10:38:26 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:26 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 Apr 02 10:38:26 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:26 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.432s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:26 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Deleted volume successfully. Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f6b33a68-744d-4677-b26e-889293ffb0c0 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-d7e98bf9-4f0d-4473-bdab-04995ce9c07e-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:26 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:26 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" returned: 0 in 0.419s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:26 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7 Apr 02 10:38:26 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info Apr 02 10:38:26 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-4c3d1a9f-091c-410f-adc2-85128cfadeec-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-4c3d1a9f-091c-410f-adc2-85128cfadeec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-4c3d1a9f-091c-410f-adc2-85128cfadeec" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-4c3d1a9f-091c-410f-adc2-85128cfadeec" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be8344f-2a61-4b9c-9596-8af37158b2bf]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:26 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:26 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a807eaba-6262-48c5-8053-b731237142f7" returned: 0 in 0.417s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-a807eaba-6262-48c5-8053-b731237142f7" released by "delete_volume" :: held 0.924s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created reservations ['93d4a74c-6b6c-4a79-999d-619f2d91fcf6', '6faecc3d-f4cf-4150-b791-2ea0dff970aa', '236989ba-e600-4c67-99fe-d8d6261d1e98', 'f7d78075-698c-41f0-964e-09b16e649aac'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:26 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info" returned: 0 in 0.444s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:26 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info is being set with open permissions: ugo+rw Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info Apr 02 10:38:26 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:26 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:26 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:26 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-45e33119-3abb-4994-84f5-955d2dd47a57-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-45e33119-3abb-4994-84f5-955d2dd47a57-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "cinder-quobyte-45e33119-3abb-4994-84f5-955d2dd47a57" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-45e33119-3abb-4994-84f5-955d2dd47a57" acquired by "delete_volume" :: waited 0.006s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27833f7-3ebf-4236-a2a3-8b07e8db54a5]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:27 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 Apr 02 10:38:27 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:27 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.510s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:27 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec Apr 02 10:38:27 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:27 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.info" returned: 0 in 0.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.744s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating offline snapshot b4e22f46-c32e-47f0-a5bf-189fdf523fc7 of volume 468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:38:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-16473f24-1ec7-41e1-9b3b-ca59b5a91f30 tempest-SnapshotDependencyTests-648399858 None] Create snapshot completed successfully Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a0450-fe47-4152-b204-3e4844dbfcf6]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:27 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:27 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Deleted volume successfully. Apr 02 10:38:27 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb Apr 02 10:38:27 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-29c138f1-16ed-420d-91db-29327b1f1ebc tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-a807eaba-6262-48c5-8053-b731237142f7-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:27 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57" returned: 0 in 0.537s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:27 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57 Apr 02 10:38:27 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Flow 'volume_create_manager' (aec84402-6252-4fc8-84cc-cc1307512a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b76c686-d3ea-4fed-8cc6-c9fc9890b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:27 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4c3d1a9f-091c-410f-adc2-85128cfadeec" returned: 0 in 0.573s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b76c686-d3ea-4fed-8cc6-c9fc9890b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f718ab-e635-4e56-ac45-72e09e51f754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359ef0a8726b4df4a823c639d8f5afa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a0519eb-ff2e-4b34-b45b-1c93604ae0b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:28Z,use_quota=True,user_id='b954eb43e1574705b684c9d5f921c914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bfcbaf-0ac9-4077-a4db-2d4942c2c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bfcbaf-0ac9-4077-a4db-2d4942c2c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76971292-514e-4fdf-882b-d17e71176c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76971292-514e-4fdf-882b-d17e71176c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9f718ab-e635-4e56-ac45-72e09e51f754', 'volume_name': 'volume-a9f718ab-e635-4e56-ac45-72e09e51f754', 'volume_size': 1, 'snapshot_id': '9a0519eb-ff2e-4b34-b45b-1c93604ae0b2'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51dfb14-02d9-451f-832e-db827f5ef937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51dfb14-02d9-451f-832e-db827f5ef937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f12b27-52ba-4515-b7f5-5fdf3a6fcd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:27 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Volume a9f718ab-e635-4e56-ac45-72e09e51f754: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9f718ab-e635-4e56-ac45-72e09e51f754', 'volume_size': 1, 'snapshot_id': '9a0519eb-ff2e-4b34-b45b-1c93604ae0b2'} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-4c3d1a9f-091c-410f-adc2-85128cfadeec" released by "delete_volume" :: held 1.151s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Created reservations ['813ecc25-7344-4be0-b93f-ce63de6e4a7a', '28d657af-d210-4bd2-a9b7-1a4e274e9403', '28143052-dafd-480a-8246-e8dc53068c43', 'd346216a-f1b2-4dd1-b166-25b0a1c49e8e'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:27 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb" returned: 0 in 0.581s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:27 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:27 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 1G Apr 02 10:38:27 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:28 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:28 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:28 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-45e33119-3abb-4994-84f5-955d2dd47a57" returned: 0 in 0.465s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-quobyte-45e33119-3abb-4994-84f5-955d2dd47a57" released by "delete_volume" :: held 1.022s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Created reservations ['fc55d097-8d12-4b5b-b1f8-b1f50cb17dd7', 'cbeab8c2-2cc6-4d10-b0bb-1a5aa3c8f051', '7d76c97a-2f50-44c4-b05c-1200511fde33', 'e1d61757-5c76-4d46-a6d7-f6393f4e71eb'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:28 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:28 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:28 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:28 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Deleted volume successfully. Apr 02 10:38:28 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 1G" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468bf296-8f57-434f-9b6d-635eeed46dbb -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-9512e680-8625-4853-bb11-c837ecfa6781 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-4c3d1a9f-091c-410f-adc2-85128cfadeec-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:28 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468bf296-8f57-434f-9b6d-635eeed46dbb -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 Apr 02 10:38:28 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:28 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.409s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:28 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Deleted volume successfully. Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a95ee2b8-d6da-4b08-b0c2-7c25a2bfa5e1 tempest-CreateVolumesFromSourceVolumeTest-642728494 None] Lock "cinder-45e33119-3abb-4994-84f5-955d2dd47a57-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:28 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468bf296-8f57-434f-9b6d-635eeed46dbb -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:28 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 is being set with open permissions: ugo+rw Apr 02 10:38:28 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:28 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 Apr 02 10:38:28 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (c87ea747-ed91-479c-a645-d136d22a293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7716cf2f-d945-433e-ac34-ecfefd44f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7716cf2f-d945-433e-ac34-ecfefd44f98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-463067415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5675e5f-c6a5-49c0-82a8-c07821dab4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4047bfdabfc24002b02cd188f78029e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:29Z,use_quota=True,user_id='928899554e12440e852ed48808f3e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6043c1-9825-4a98-bbfd-ae24fd6a108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6043c1-9825-4a98-bbfd-ae24fd6a108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84653b1b-a90c-4691-9b68-a43842f18905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84653b1b-a90c-4691-9b68-a43842f18905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'volume_name': 'volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba8de37-f524-43b4-8ce8-7bd94e7a3a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba8de37-f524-43b4-8ce8-7bd94e7a3a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31e43a9-61f2-441e-9b4f-8b60623575f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:29 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Volume a5675e5f-c6a5-49c0-82a8-c07821dab4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'volume_size': 1} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:29 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7" returned: 0 in 0.432s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:29 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info Apr 02 10:38:29 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:29 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info" returned: 0 in 0.430s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:29 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info is being set with open permissions: ugo+rw Apr 02 10:38:29 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:29 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info Apr 02 10:38:29 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:30 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.info" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.301s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-quobyte-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2-a9f718ab-e635-4e56-ac45-72e09e51f754" by "_create_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2-a9f718ab-e635-4e56-ac45-72e09e51f754" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Creating volume a9f718ab-e635-4e56-ac45-72e09e51f754 from snapshot 9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-quobyte-a9f718ab-e635-4e56-ac45-72e09e51f754" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:30 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-0da172c8-d8b2-4790-be88-6c7c03c0d8ed tempest-CreateVolumesFromSnapshotTest-654744706 None] Create snapshot completed successfully Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-a9f718ab-e635-4e56-ac45-72e09e51f754" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] snapshot: 9a0519eb-ff2e-4b34-b45b-1c93604ae0b2, volume: a9f718ab-e635-4e56-ac45-72e09e51f754, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[682a199a-0c6b-445f-9d4f-f68a4909dd1f]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:30 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 Apr 02 10:38:30 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:30 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" returned: 0 in 0.485s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acedccb-eb2f-4b38-9b06-2b2dcbb907c2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:30 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:30 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Flow 'volume_create_manager' (cfec89ed-189e-41b0-aead-cbd5f00b837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f8f045-2e40-484b-bf26-2f115aa42c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f8f045-2e40-484b-bf26-2f115aa42c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1969bef6-26f6-44be-b677-04db49129bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f315030c9545f2abe9dcf4a55d95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='b42b9f6babf1437ba20c1697d5aa3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff633f5-9ffe-461a-a329-60ac0bdcefa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff633f5-9ffe-461a-a329-60ac0bdcefa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b870b3b-38ee-4f55-bbe9-73552f0bdad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b870b3b-38ee-4f55-bbe9-73552f0bdad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1969bef6-26f6-44be-b677-04db49129bfe', 'volume_name': 'volume-1969bef6-26f6-44be-b677-04db49129bfe', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63742ab5-520a-4870-8027-9924018fb6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63742ab5-520a-4870-8027-9924018fb6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e94418-5c7b-4ca1-aeb0-b78b8b04d32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:30 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Volume 1969bef6-26f6-44be-b677-04db49129bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1969bef6-26f6-44be-b677-04db49129bfe', 'volume_size': 1} Apr 02 10:38:30 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (8f1a4e53-3107-48d7-be88-42f3ebc72e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c85d8d-406c-42f6-8b05-9b08dc91dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c85d8d-406c-42f6-8b05-9b08dc91dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958799841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af5e9bc-fdc4-4862-9f82-3554bfafc220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62a5652-90f1-4993-967d-3fb492a3207b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62a5652-90f1-4993-967d-3fb492a3207b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7004e7-d778-4bd2-a57d-8c0d1fa5729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7004e7-d778-4bd2-a57d-8c0d1fa5729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af5e9bc-fdc4-4862-9f82-3554bfafc220', 'volume_name': 'volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbf7182-2e0e-471c-9b53-47647aa4eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbf7182-2e0e-471c-9b53-47647aa4eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b904f5-442c-4aba-b0ed-b29deb64708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume 7af5e9bc-fdc4-4862-9f82-3554bfafc220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220', 'volume_size': 1} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (d9d9590e-21ec-40b4-b162-666b92c666ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1962211-a06c-4b86-8e93-a2e0fca3dfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1962211-a06c-4b86-8e93-a2e0fca3dfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879286052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a9c4c2-a1c6-4d28-8d44-2575208143a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ea7d9d-7fb8-4290-a83d-7a75c890a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ea7d9d-7fb8-4290-a83d-7a75c890a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f4520c-d06b-43b6-a94c-eb7e14477135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f4520c-d06b-43b6-a94c-eb7e14477135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a9c4c2-a1c6-4d28-8d44-2575208143a2', 'volume_name': 'volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606566e1-934f-4c85-bdec-f7c369ec3082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606566e1-934f-4c85-bdec-f7c369ec3082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e133c7-915f-44f5-8397-c3566bd1424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume 93a9c4c2-a1c6-4d28-8d44-2575208143a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2', 'volume_size': 1} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:31 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.569s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:31 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 Apr 02 10:38:31 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (7fcb3ea4-6963-40ea-82fa-045845cd6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d12f00-115c-4aab-94e5-593ae4df717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d12f00-115c-4aab-94e5-593ae4df717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798241080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3bf594-644b-42b5-823e-9b47fe6be3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dede8ba-ba4e-437d-9684-e16e64049bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dede8ba-ba4e-437d-9684-e16e64049bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bda7c9b-ea57-40b1-b347-8b9be6de61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bda7c9b-ea57-40b1-b347-8b9be6de61b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3bf594-644b-42b5-823e-9b47fe6be3d4', 'volume_name': 'volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886af178-9d50-4f9a-8896-0064576fc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886af178-9d50-4f9a-8896-0064576fc07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e3ab01-7a48-4245-a68e-3bc3b3b5f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume 4d3bf594-644b-42b5-823e-9b47fe6be3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4', 'volume_size': 1} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (99ccb5be-727d-4c1b-9ade-ebeb06d236f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003288b0-e61e-4fc7-b6a9-53a6c30add12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003288b0-e61e-4fc7-b6a9-53a6c30add12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101158162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab185e6e-c033-4805-a194-6fa3be68f1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:32Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e385db-8560-4eb5-a2c6-0d348da32920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e385db-8560-4eb5-a2c6-0d348da32920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab5ea7f-1d19-4205-b709-e2947ba00d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab5ea7f-1d19-4205-b709-e2947ba00d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab185e6e-c033-4805-a194-6fa3be68f1d2', 'volume_name': 'volume-ab185e6e-c033-4805-a194-6fa3be68f1d2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4c9efa-6bcd-44c2-93e0-d5cefc7731d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4c9efa-6bcd-44c2-93e0-d5cefc7731d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25009cb-be98-44c4-b3f8-a5afe973b819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume ab185e6e-c033-4805-a194-6fa3be68f1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab185e6e-c033-4805-a194-6fa3be68f1d2', 'volume_size': 1} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (e050696b-3fff-4042-8eae-404c90513e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22be5b33-9782-4b91-9366-2c844d4c5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22be5b33-9782-4b91-9366-2c844d4c5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021986684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c2096b-da2c-4397-be94-d9cc2dc8d604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:32Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66c7932-bbd4-4db0-bef4-e29ad738fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66c7932-bbd4-4db0-bef4-e29ad738fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d1886a-5f3b-4543-8798-71f0500412e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d1886a-5f3b-4543-8798-71f0500412e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c2096b-da2c-4397-be94-d9cc2dc8d604', 'volume_name': 'volume-67c2096b-da2c-4397-be94-d9cc2dc8d604', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106cf425-726e-45ef-ac6b-1cf606b3042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106cf425-726e-45ef-ac6b-1cf606b3042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332e4c20-47fc-4abf-bdf7-081d982e9574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:31 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume 67c2096b-da2c-4397-be94-d9cc2dc8d604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c2096b-da2c-4397-be94-d9cc2dc8d604', 'volume_size': 1} Apr 02 10:38:31 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:33 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754" returned: 0 in 2.068s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:33 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[076da49d-a5f0-4222-bf12-ceb4fcfc4cde]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:33 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:33 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:33 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.552s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:33 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:38:33 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Converted 1024.00 MB image at 494.95 MB/s Apr 02 10:38:33 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 is being set with open permissions: ugo+rw Apr 02 10:38:33 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:34 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 Apr 02 10:38:34 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:34 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754" returned: 0 in 0.399s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-a9f718ab-e635-4e56-ac45-72e09e51f754" released by "_copy_volume_from_snapshot" :: held 4.137s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2-a9f718ab-e635-4e56-ac45-72e09e51f754" released by "_create_volume_from_snapshot" :: held 4.159s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.178s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.211s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-463067415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5675e5f-c6a5-49c0-82a8-c07821dab4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4047bfdabfc24002b02cd188f78029e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:29Z,use_quota=True,user_id='928899554e12440e852ed48808f3e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Creating volume a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:34 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:34 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 1073741824 Apr 02 10:38:34 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f12b27-52ba-4515-b7f5-5fdf3a6fcd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f718ab-e635-4e56-ac45-72e09e51f754', 'volume_size': 1, 'snapshot_id': '9a0519eb-ff2e-4b34-b45b-1c93604ae0b2'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218ef98-793b-4b9b-acdd-df29d9260f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:34 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Volume volume-a9f718ab-e635-4e56-ac45-72e09e51f754 (a9f718ab-e635-4e56-ac45-72e09e51f754): created successfully Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a218ef98-793b-4b9b-acdd-df29d9260f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Flow 'volume_create_manager' (aec84402-6252-4fc8-84cc-cc1307512a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:34 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2f62de04-c35a-4e6e-82ff-e92eac3ee485 tempest-SnapshotDependencyTests-648399858 None] Created volume successfully. Apr 02 10:38:34 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 1073741824" returned: 0 in 0.458s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:34 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:34 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:34 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:35 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.401s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.327s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1969bef6-26f6-44be-b677-04db49129bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f315030c9545f2abe9dcf4a55d95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='b42b9f6babf1437ba20c1697d5aa3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Creating volume 1969bef6-26f6-44be-b677-04db49129bfe {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:35 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31e43a9-61f2-441e-9b4f-8b60623575f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:35 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe 1073741824 Apr 02 10:38:35 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fd6e38-ef7d-49ca-aaea-64e3825d6755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:35 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Volume volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 (a5675e5f-c6a5-49c0-82a8-c07821dab4b5): created successfully Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fd6e38-ef7d-49ca-aaea-64e3825d6755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (c87ea747-ed91-479c-a645-d136d22a293d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-quobyte-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:35 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-69533dca-1490-41f7-8389-bb2071b13230 tempest-VolumeDependencyTests-1705136307 None] Created volume successfully. Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-quobyte-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Deleting offline snapshot 9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 of volume 4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] snapshot_file for this snap is: volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db38f69-3fcb-4510-8a97-67c1c791dd7c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:35 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 Apr 02 10:38:35 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (ec6b7188-e10a-4a2b-9f65-c5c37dc12c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e4a3a0-73bb-425a-990f-5e9d429ce469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e4a3a0-73bb-425a-990f-5e9d429ce469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1929943034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726db77f-e376-47c8-a2af-2ad91c136e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4047bfdabfc24002b02cd188f78029e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a5675e5f-c6a5-49c0-82a8-c07821dab4b5,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:36Z,use_quota=True,user_id='928899554e12440e852ed48808f3e30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a908fb-bbf5-49eb-b099-cf29c5207413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a908fb-bbf5-49eb-b099-cf29c5207413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551b0c66-05e9-4f6e-8c79-4435b5929230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:35 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:35 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551b0c66-05e9-4f6e-8c79-4435b5929230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '726db77f-e376-47c8-a2af-2ad91c136e30', 'volume_name': 'volume-726db77f-e376-47c8-a2af-2ad91c136e30', 'volume_size': 1, 'source_volid': 'a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d02641-0467-47d6-b952-ac2b4597d297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d02641-0467-47d6-b952-ac2b4597d297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87da8f0-0a57-4b77-a8dc-b6e75f68b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:35 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Volume 726db77f-e376-47c8-a2af-2ad91c136e30: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-726db77f-e376-47c8-a2af-2ad91c136e30', 'volume_size': 1, 'source_volid': 'a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'source_volstatus': 'available'} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe 1073741824" returned: 0 in 0.573s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" returned: 0 in 0.484s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27d18cd-47d6-45bb-96e4-63c004691ba4]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:35 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:35 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe Apr 02 10:38:35 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:35 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:35 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:36 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe" returned: 0 in 0.414s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.264s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958799841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af5e9bc-fdc4-4862-9f82-3554bfafc220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating volume 7af5e9bc-fdc4-4862-9f82-3554bfafc220 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:36 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:36 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:36 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 1073741824 Apr 02 10:38:36 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e94418-5c7b-4ca1-aeb0-b78b8b04d32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1969bef6-26f6-44be-b677-04db49129bfe', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e76a10-b724-45de-bc4b-c4016de3179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:36 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 Apr 02 10:38:36 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:36 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Volume volume-1969bef6-26f6-44be-b677-04db49129bfe (1969bef6-26f6-44be-b677-04db49129bfe): created successfully Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e76a10-b724-45de-bc4b-c4016de3179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Flow 'volume_create_manager' (cfec89ed-189e-41b0-aead-cbd5f00b837d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:36 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-712a5841-f4fa-4960-8b47-8bcd7b76bc9c tempest-CinderUnicodeTest-946972067 None] Created volume successfully. Apr 02 10:38:36 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 1073741824" returned: 0 in 0.461s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:36 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:36 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:36 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 Apr 02 10:38:36 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:36 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2 Apr 02 10:38:36 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:37 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220" returned: 0 in 0.392s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.956s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879286052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a9c4c2-a1c6-4d28-8d44-2575208143a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating volume 93a9c4c2-a1c6-4d28-8d44-2575208143a2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:37 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b904f5-442c-4aba-b0ed-b29deb64708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e036781-0309-4fec-8c4c-092808157043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:37 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 1073741824 Apr 02 10:38:37 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:37 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb.9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" returned: 0 in 0.425s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:37 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 (7af5e9bc-fdc4-4862-9f82-3554bfafc220): created successfully Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e036781-0309-4fec-8c4c-092808157043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (8f1a4e53-3107-48d7-be88-42f3ebc72e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2" released by "_delete_snapshot" :: held 1.932s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-2a6feb04-7056-413b-8763-25cc77e2b32d tempest-CreateVolumesFromSnapshotTest-654744706 None] Created volume successfully. Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" released by "delete_snapshot" :: held 1.946s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Created reservations ['5561c5bc-c1f7-4e4e-9bab-bcbe43a17611', '9cf517dd-d84e-41f8-b707-22e007204d2c', '82f925e8-9881-4e1f-ae8b-88b231be2aa6', '5049d97c-8359-4801-b526-af2513129dd8'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:37 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Delete snapshot completed successfully. Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-3e51799d-3b78-48cc-be95-6cd28b580f66 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-9a0519eb-ff2e-4b34-b45b-1c93604ae0b2-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-quobyte-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94dcf15-fbc9-4734-8e23-0b8e5f548fb8]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Flow 'volume_create_manager' (1977b0e9-177a-40bc-9f3f-e277efd268aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5d2ca3-b238-4989-a5ad-665cc75b76c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5d2ca3-b238-4989-a5ad-665cc75b76c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1311191017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09edb73-541c-4f81-b0e8-35fe7127af3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f315030c9545f2abe9dcf4a55d95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:38Z,use_quota=True,user_id='b42b9f6babf1437ba20c1697d5aa3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:37 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:37 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb20270-6e2d-4041-9158-05ec7daedf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb20270-6e2d-4041-9158-05ec7daedf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a615bd-6772-467d-9b73-4f78041dcc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a615bd-6772-467d-9b73-4f78041dcc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09edb73-541c-4f81-b0e8-35fe7127af3c', 'volume_name': 'volume-c09edb73-541c-4f81-b0e8-35fe7127af3c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cc21d8-c59f-49bb-b9bc-2bf8facbd2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cc21d8-c59f-49bb-b9bc-2bf8facbd2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062eff4e-f76a-47f8-adac-c6a5aaef3502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:37 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Volume c09edb73-541c-4f81-b0e8-35fe7127af3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09edb73-541c-4f81-b0e8-35fe7127af3c', 'volume_size': 1} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:37 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 1073741824" returned: 0 in 0.551s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:37 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:37 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 Apr 02 10:38:37 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:38 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.480s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:38 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb Apr 02 10:38:38 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:38 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2" returned: 0 in 0.391s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.744s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1798241080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3bf594-644b-42b5-823e-9b47fe6be3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:31Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating volume 4d3bf594-644b-42b5-823e-9b47fe6be3d4 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:38 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e133c7-915f-44f5-8397-c3566bd1424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:38 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 1073741824 Apr 02 10:38:38 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b6b736-612e-44fe-9c39-d00530dc281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:38 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 (93a9c4c2-a1c6-4d28-8d44-2575208143a2): created successfully Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b6b736-612e-44fe-9c39-d00530dc281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (d9d9590e-21ec-40b4-b162-666b92c666ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7c3bf743-4fed-4599-8566-b1b016877ed6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created volume successfully. Apr 02 10:38:38 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" returned: 0 in 0.399s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb" released by "delete_volume" :: held 0.913s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Created reservations ['eeda6fcb-2494-473c-9dab-cb44917be8e8', '8d87c2f7-c393-4d3d-aa8c-a356b7b0244b', '089d06cc-1d66-444e-9e20-9f15f1650b3d', '7bf86bf0-dd67-45a4-8909-772ad503d7b4'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:38 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:38 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-a9f718ab-e635-4e56-ac45-72e09e51f754-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-a9f718ab-e635-4e56-ac45-72e09e51f754-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "cinder-quobyte-a9f718ab-e635-4e56-ac45-72e09e51f754" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-a9f718ab-e635-4e56-ac45-72e09e51f754" acquired by "delete_volume" :: waited 0.022s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7659d49-f474-4141-bf2e-b9c82ee15eee]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:38 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 Apr 02 10:38:38 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:38 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 1073741824" returned: 0 in 0.523s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:38 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 Apr 02 10:38:38 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:38 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.466s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:38 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Deleted volume successfully. Apr 02 10:38:38 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-1f5ce81e-3f43-4933-a8c6-0a84f438e937 tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-4eccffd8-b018-4210-96f5-a5d5a5e1eaeb-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:39 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754" returned: 0 in 0.508s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:39 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754 Apr 02 10:38:39 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:39 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4" returned: 0 in 0.427s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.560s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101158162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab185e6e-c033-4805-a194-6fa3be68f1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:32Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating volume ab185e6e-c033-4805-a194-6fa3be68f1d2 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:39 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e3ab01-7a48-4245-a68e-3bc3b3b5f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e1b7ab-0e62-47df-9acb-e760ab5806e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:39 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 1073741824 Apr 02 10:38:39 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:39 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 (4d3bf594-644b-42b5-823e-9b47fe6be3d4): created successfully Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e1b7ab-0e62-47df-9acb-e760ab5806e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (7fcb3ea4-6963-40ea-82fa-045845cd6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:39 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e1dc16c0-09fb-4e5e-87d4-b5885f9d975a tempest-CreateVolumesFromSnapshotTest-654744706 None] Created volume successfully. Apr 02 10:38:39 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a9f718ab-e635-4e56-ac45-72e09e51f754" returned: 0 in 0.388s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-quobyte-a9f718ab-e635-4e56-ac45-72e09e51f754" released by "delete_volume" :: held 0.918s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Created reservations ['068b963c-1733-475e-b7f1-621089d645a8', '6c9132a8-f264-4e29-9d76-0e3fa3f4aee3', '18540903-fd4f-4405-b818-e50286174705', '376b254d-de78-4dc9-a4a8-59d6a57e5838'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:39 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:39 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:39 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 1073741824" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:39 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:39 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 Apr 02 10:38:39 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:40 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.420s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Deleted volume successfully. Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-37e4af5d-334a-4192-9af5-28ab32ca0b0d tempest-SnapshotDependencyTests-648399858 None] Lock "cinder-a9f718ab-e635-4e56-ac45-72e09e51f754-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:40 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2" returned: 0 in 0.422s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.200s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021986684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c2096b-da2c-4397-be94-d9cc2dc8d604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9327165689954d33a5d3815283240e45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:32Z,use_quota=True,user_id='01e3f5c84b6145559b986b871aeb87ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Creating volume 67c2096b-da2c-4397-be94-d9cc2dc8d604 {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:40 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25009cb-be98-44c4-b3f8-a5afe973b819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab185e6e-c033-4805-a194-6fa3be68f1d2', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc118ea-bafd-4466-bf43-4794ecf8e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:40 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 1073741824 Apr 02 10:38:40 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:40 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 (ab185e6e-c033-4805-a194-6fa3be68f1d2): created successfully Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc118ea-bafd-4466-bf43-4794ecf8e27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (99ccb5be-727d-4c1b-9ade-ebeb06d236f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:40 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f424af08-381a-4dd1-8c5d-ac67fa514570 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created volume successfully. Apr 02 10:38:40 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 1073741824" returned: 0 in 0.526s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:40 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:40 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 Apr 02 10:38:40 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:41 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604" returned: 0 in 0.447s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.241s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:41 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Cloning volume a5675e5f-c6a5-49c0-82a8-c07821dab4b5 to volume 726db77f-e376-47c8-a2af-2ad91c136e30 Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332e4c20-47fc-4abf-bdf7-081d982e9574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c2096b-da2c-4397-be94-d9cc2dc8d604', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f0e6bc-a129-45c6-b2dc-dcc5b6dcbc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:41 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Volume volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 (67c2096b-da2c-4397-be94-d9cc2dc8d604): created successfully Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f0e6bc-a129-45c6-b2dc-dcc5b6dcbc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Flow 'volume_create_manager' (e050696b-3fff-4042-8eae-404c90513e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Creating offline snapshot ee795f4b-89c0-447c-b6b4-897f1ba105bb of volume a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:38:41 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-81a65bd6-6969-4405-b4c3-020a6c72b1a7 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created volume successfully. Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a197be-940a-4729-a77b-95cdf7f37889]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:41 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:41 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-67c2096b-da2c-4397-be94-d9cc2dc8d604-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-67c2096b-da2c-4397-be94-d9cc2dc8d604-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-67c2096b-da2c-4397-be94-d9cc2dc8d604" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-67c2096b-da2c-4397-be94-d9cc2dc8d604" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bcf109-07df-424b-9eda-693d65bbb118]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:41 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 Apr 02 10:38:41 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:41 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.493s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:41 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:41 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb 1G Apr 02 10:38:41 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:42 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604" returned: 0 in 0.534s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:42 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604 Apr 02 10:38:42 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:42 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb 1G" returned: 0 in 0.553s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:42 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb Apr 02 10:38:42 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:42 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-67c2096b-da2c-4397-be94-d9cc2dc8d604" returned: 0 in 0.411s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-67c2096b-da2c-4397-be94-d9cc2dc8d604" released by "delete_volume" :: held 0.985s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['c9f64931-0243-474a-9289-61c5e66295d7', '0f816825-f9ec-4c81-bfc3-ea2040bf8448', '749ce9a9-44d1-47fe-b165-613b807aaf64', 'a6394ede-366f-4c9f-b103-4417b9fe68f6'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:42 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:42 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:42 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb" returned: 0 in 0.476s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:42 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb is being set with open permissions: ugo+rw Apr 02 10:38:42 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:42 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb Apr 02 10:38:42 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:43 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.458s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:43 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleted volume successfully. Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8228a962-77b8-4f4f-bdfa-9a46ecaa41a6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-67c2096b-da2c-4397-be94-d9cc2dc8d604-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:43 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:43 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info Apr 02 10:38:43 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:43 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:43 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info is being set with open permissions: ugo+rw Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:43 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info Apr 02 10:38:43 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-ab185e6e-c033-4805-a194-6fa3be68f1d2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-ab185e6e-c033-4805-a194-6fa3be68f1d2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-ab185e6e-c033-4805-a194-6fa3be68f1d2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-ab185e6e-c033-4805-a194-6fa3be68f1d2" acquired by "delete_volume" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6cb62a-ecc4-45f5-a24f-4394f92cc606]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:43 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:43 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 Apr 02 10:38:43 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:44 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.info" returned: 0 in 0.469s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-726db77f-e376-47c8-a2af-2ad91c136e30" by "_copy_volume_from_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-726db77f-e376-47c8-a2af-2ad91c136e30" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] snapshot: ee795f4b-89c0-447c-b6b4-897f1ba105bb, volume: 726db77f-e376-47c8-a2af-2ad91c136e30, {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[020ebdd7-68ee-495b-bf3e-05b8cb06ca73]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:44 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb Apr 02 10:38:44 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:44 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2" returned: 0 in 0.545s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:44 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2 Apr 02 10:38:44 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:44 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb" returned: 0 in 0.539s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Creating direct copy from snapshot {{(pid=82391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded84ad-4ffc-49ba-90c2-3bda3502c682]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:44 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-ab185e6e-c033-4805-a194-6fa3be68f1d2" returned: 0 in 0.454s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-ab185e6e-c033-4805-a194-6fa3be68f1d2" released by "delete_volume" :: held 1.031s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:44 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:44 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['2ba986ee-acef-4abf-a8a0-321b0c0e56de', '609adec9-bbd6-4a51-a2f8-f04a2e8a00cd', 'f4c94a1f-317a-40f4-9127-063ada12f39f', 'e3efb5bd-70ae-427c-82d7-539322af2fad'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:44 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:44 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:44 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:45 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.536s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:45 devstack cinder-volume[82391]: DEBUG cinder.utils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Path /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 not found in is_blk_device check {{(pid=82391) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 02 10:38:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:45 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 Apr 02 10:38:45 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:45 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:45 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.507s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:45 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:45 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleted volume successfully. Apr 02 10:38:45 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-72b4960e-e7a6-4262-a0da-13dcdc809781 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-ab185e6e-c033-4805-a194-6fa3be68f1d2-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-4d3bf594-644b-42b5-823e-9b47fe6be3d4-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-4d3bf594-644b-42b5-823e-9b47fe6be3d4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-4d3bf594-644b-42b5-823e-9b47fe6be3d4" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-4d3bf594-644b-42b5-823e-9b47fe6be3d4" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140cb1e-5be4-4f51-9223-e68a4879a9f9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo_service.periodic_task [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:46 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:46 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:46 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:46 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 Apr 02 10:38:46 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:47 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 1.312s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-73994bb9-b52b-4fa2-b956-e6fccc2beb8b None None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:47 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30" returned: 0 in 2.448s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d54e2-590d-44e1-9eba-76c0891a7061]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:47 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:47 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:47 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4" returned: 0 in 1.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:47 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:47 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4 Apr 02 10:38:47 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:48 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-4d3bf594-644b-42b5-823e-9b47fe6be3d4" returned: 0 in 0.401s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-4d3bf594-644b-42b5-823e-9b47fe6be3d4" released by "delete_volume" :: held 1.959s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['5e741df8-1d1a-4fff-a741-f7a992d6f26e', 'c1127d6d-714f-4d8d-a5a2-822b976d967d', '1d09cb77-5edd-4eab-81d3-26b0f99d024a', 'bd0452be-b955-4991-bc0e-4e7c2708b9d0'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:48 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.572s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.image.image_utils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Image conversion details: src /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 {{(pid=82391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 02 10:38:48 devstack cinder-volume[82391]: INFO cinder.image.image_utils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Converted 1024.00 MB image at 418.14 MB/s Apr 02 10:38:48 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 is being set with open permissions: ugo+rw Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:48 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 Apr 02 10:38:48 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:48 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:48 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-93a9c4c2-a1c6-4d28-8d44-2575208143a2-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-93a9c4c2-a1c6-4d28-8d44-2575208143a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-93a9c4c2-a1c6-4d28-8d44-2575208143a2" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-93a9c4c2-a1c6-4d28-8d44-2575208143a2" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d034fa5-bded-4dec-bcdd-27e2aad70774]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:48 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 Apr 02 10:38:48 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:48 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-726db77f-e376-47c8-a2af-2ad91c136e30" released by "_copy_volume_from_snapshot" :: held 4.569s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-ee795f4b-89c0-447c-b6b4-897f1ba105bb" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-ee795f4b-89c0-447c-b6b4-897f1ba105bb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Deleting offline snapshot ee795f4b-89c0-447c-b6b4-897f1ba105bb of volume a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] snapshot_file for this snap is: volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34d986-3185-47f6-9317-50e72bb2b5d3]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:48 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.438s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:48 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleted volume successfully. Apr 02 10:38:48 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-8c86cdf7-0cb9-41f9-8a1d-417ca82800e3 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-4d3bf594-644b-42b5-823e-9b47fe6be3d4-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:48 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb Apr 02 10:38:48 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:49 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2" returned: 0 in 0.473s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:49 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2 Apr 02 10:38:49 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:49 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb" returned: 0 in 0.469s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d82e54e-a8a1-4c07-b5f3-88950c318f41]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:49 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:49 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:49 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-93a9c4c2-a1c6-4d28-8d44-2575208143a2" returned: 0 in 0.409s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-93a9c4c2-a1c6-4d28-8d44-2575208143a2" released by "delete_volume" :: held 0.906s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['461c7b60-088f-4d97-9aac-e346923a9d70', '1c43dc09-9df9-4687-a5df-17d3e4b32e3b', '1042809d-9462-4769-8d7e-7ce1f52bf50a', 'af3ba7a0-03cc-4183-9171-9132b7e9baea'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:49 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:49 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-7af5e9bc-fdc4-4862-9f82-3554bfafc220-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:49 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-7af5e9bc-fdc4-4862-9f82-3554bfafc220-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.491s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:49 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb Apr 02 10:38:49 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-7af5e9bc-fdc4-4862-9f82-3554bfafc220" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-7af5e9bc-fdc4-4862-9f82-3554bfafc220" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c738c284-a3ff-494d-8e7d-0574f45efe6c]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:49 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:49 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 Apr 02 10:38:49 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:50 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleted volume successfully. Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-7efa91a2-0a0c-4eb8-8368-c27961a5d8f6 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-93a9c4c2-a1c6-4d28-8d44-2575208143a2-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:50 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb" returned: 0 in 0.460s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:50 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb Apr 02 10:38:50 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:50 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:50 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220 Apr 02 10:38:50 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:50 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5.ee795f4b-89c0-447c-b6b4-897f1ba105bb" returned: 0 in 0.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-ee795f4b-89c0-447c-b6b4-897f1ba105bb" released by "_delete_snapshot" :: held 1.876s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.483s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.007s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-02T08:38:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1311191017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09edb73-541c-4f81-b0e8-35fe7127af3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f315030c9545f2abe9dcf4a55d95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:38:38Z,use_quota=True,user_id='b42b9f6babf1437ba20c1697d5aa3442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f),volume_type_id=ef1070ae-b5a6-4c0b-ab1f-c3799c71b72f)}" {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Creating volume c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Selected osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 as target Quobyte volume. {{(pid=82391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 02 10:38:50 devstack cinder-volume[82391]: INFO cinder.volume.drivers.remotefs [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] casted to osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372 Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c 1073741824 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87da8f0-0a57-4b77-a8dc-b6e75f68b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726db77f-e376-47c8-a2af-2ad91c136e30', 'volume_size': 1, 'source_volid': 'a5675e5f-c6a5-49c0-82a8-c07821dab4b5', 'source_volstatus': 'available'}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:50 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c 1073741824 Apr 02 10:38:50 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830fc869-5de5-47ac-b8d5-07923df99e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:50 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:50 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Volume volume-726db77f-e376-47c8-a2af-2ad91c136e30 (726db77f-e376-47c8-a2af-2ad91c136e30): created successfully Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830fc869-5de5-47ac-b8d5-07923df99e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Flow 'volume_create_manager' (ec6b7188-e10a-4a2b-9f65-c5c37dc12c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-7af5e9bc-fdc4-4862-9f82-3554bfafc220" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-7af5e9bc-fdc4-4862-9f82-3554bfafc220" released by "delete_volume" :: held 0.925s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:50 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5306da48-8205-4e04-9542-a7c3fffb36d8 tempest-VolumeDependencyTests-1705136307 None] Created volume successfully. Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['b25ea885-3ab0-4338-8736-a0699599a93c', '5ce92a55-bf21-4d58-9c12-79ddaa878d42', '5700fdba-7564-470d-81a5-c7d7a94df1c9', '11c01674-d50f-4f6b-97dd-4ebcae85dcf7'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:50 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:50 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-b4e22f46-c32e-47f0-a5bf-189fdf523fc7-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-b4e22f46-c32e-47f0-a5bf-189fdf523fc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-468bf296-8f57-434f-9b6d-635eeed46dbb" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-468bf296-8f57-434f-9b6d-635eeed46dbb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-b4e22f46-c32e-47f0-a5bf-189fdf523fc7" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-b4e22f46-c32e-47f0-a5bf-189fdf523fc7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleting offline snapshot b4e22f46-c32e-47f0-a5bf-189fdf523fc7 of volume 468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] snapshot_file for this snap is: volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae44d14-f220-41cb-9caa-3e1fd1118a5a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:50 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:50 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 Apr 02 10:38:50 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:51 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c 1073741824" returned: 0 in 0.507s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:51 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.406s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:51 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleted volume successfully. Apr 02 10:38:51 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c Apr 02 10:38:51 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f061cccd-5d44-4a80-bbce-1f7245683106 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-7af5e9bc-fdc4-4862-9f82-3554bfafc220-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:51 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7" returned: 0 in 0.450s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-468bf296-8f57-434f-9b6d-635eeed46dbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a6c24-5aee-4a49-9d06-3ca72b8bd0c9]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:51 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb Apr 02 10:38:51 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:51 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c" returned: 0 in 0.408s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'} {{(pid=82391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (062eff4e-f76a-47f8-adac-c6a5aaef3502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09edb73-541c-4f81-b0e8-35fe7127af3c', 'volume_size': 1}' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75467e6e-b72a-4240-903e-9ef3afbc3371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 02 10:38:51 devstack cinder-volume[82391]: INFO cinder.volume.flows.manager.create_volume [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Volume volume-c09edb73-541c-4f81-b0e8-35fe7127af3c (c09edb73-541c-4f81-b0e8-35fe7127af3c): created successfully Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75467e6e-b72a-4240-903e-9ef3afbc3371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82391) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Flow 'volume_create_manager' (1977b0e9-177a-40bc-9f3f-e277efd268aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82391) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 02 10:38:51 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e53a268a-8069-4835-b84c-9044f809e53d tempest-CinderUnicodeTest-946972067 None] Created volume successfully. Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-a5675e5f-c6a5-49c0-82a8-c07821dab4b5-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-a5675e5f-c6a5-49c0-82a8-c07821dab4b5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ebe78-6150-457b-b190-d3ca180f3198]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:51 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb" returned: 0 in 0.464s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:51 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:51 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 Apr 02 10:38:51 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:51 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:51 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:52 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7" returned: 0 in 0.421s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:52 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.466s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:52 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7 Apr 02 10:38:52 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:52 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5 Apr 02 10:38:52 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:52 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb.b4e22f46-c32e-47f0-a5bf-189fdf523fc7" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:52 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" returned: 0 in 0.424s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Creating offline snapshot 7c8ab5c0-d22d-4fbd-a54d-f47056e74149 of volume c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-a5675e5f-c6a5-49c0-82a8-c07821dab4b5" released by "delete_volume" :: held 0.939s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c86bbc-47d6-4934-a80c-08f1334c5db2]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-b4e22f46-c32e-47f0-a5bf-189fdf523fc7" released by "_delete_snapshot" :: held 1.845s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-468bf296-8f57-434f-9b6d-635eeed46dbb" released by "delete_snapshot" :: held 1.872s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Created reservations ['ff4b202c-8c41-43a5-bf5d-f145bbcce468', '9ddc1e54-0e49-46c4-8aa2-4ed1c44e1585', '3fbf94cd-f647-4f2e-b4a7-31927b3c61c9', 'f871f1b3-f17c-4c49-9235-f642b082c15c'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['1206d731-06ce-44ac-bdb2-bf53c80594a5', '27aff38e-e119-4288-a4b5-8b9c5274c6c0', '1505a390-9409-44ae-afd7-75c4ba961388', '57f111d7-16d7-4d95-a219-bf6b2b6d8936'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:52 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c Apr 02 10:38:52 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:52 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:52 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-726db77f-e376-47c8-a2af-2ad91c136e30-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:52 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Delete snapshot completed successfully. Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-726db77f-e376-47c8-a2af-2ad91c136e30-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f4c72a5a-3e49-491d-9eae-c24c0581b211 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-b4e22f46-c32e-47f0-a5bf-189fdf523fc7-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-726db77f-e376-47c8-a2af-2ad91c136e30" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-726db77f-e376-47c8-a2af-2ad91c136e30" acquired by "delete_volume" :: waited 0.012s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d85f81-b889-4f5c-b3b8-322808ec81cd]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-468bf296-8f57-434f-9b6d-635eeed46dbb-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:52 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-468bf296-8f57-434f-9b6d-635eeed46dbb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "cinder-quobyte-468bf296-8f57-434f-9b6d-635eeed46dbb" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-468bf296-8f57-434f-9b6d-635eeed46dbb" acquired by "delete_volume" :: waited 0.009s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:53 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 Apr 02 10:38:53 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d012e-4265-4177-9e3a-c4fc53688d50]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:53 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb Apr 02 10:38:53 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:53 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c" returned: 0 in 0.531s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 1G {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:53 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 1G Apr 02 10:38:53 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.440s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:53 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Deleted volume successfully. Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-e990de25-234a-429f-bc53-7d834177abea tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-a5675e5f-c6a5-49c0-82a8-c07821dab4b5-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:53 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30" returned: 0 in 0.587s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:53 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30 Apr 02 10:38:53 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:53 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:53 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb Apr 02 10:38:53 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:53 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 1G" returned: 0 in 0.468s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09edb73-541c-4f81-b0e8-35fe7127af3c -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:53 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09edb73-541c-4f81-b0e8-35fe7127af3c -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 Apr 02 10:38:53 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:53 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-726db77f-e376-47c8-a2af-2ad91c136e30" returned: 0 in 0.444s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-468bf296-8f57-434f-9b6d-635eeed46dbb" returned: 0 in 0.419s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-726db77f-e376-47c8-a2af-2ad91c136e30" released by "delete_volume" :: held 1.063s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:53 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-quobyte-468bf296-8f57-434f-9b6d-635eeed46dbb" released by "delete_volume" :: held 0.929s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Created reservations ['53c824e2-78db-46b8-b8b5-ea2287c97059', 'c8210902-b888-4009-ba68-62451b33aa07', '0138c844-4cd8-44f8-bcfe-539097b47664', '587ee1bd-7be2-4455-a74c-2920a82a35a4'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Created reservations ['18d2ffea-89f9-495a-9f37-573e3516abfc', '6c8b2612-77ef-47e7-9366-91f9663d3cdf', 'b2d8a38b-7c4b-4039-923a-3fd15dab14ab', '1f536f8b-8d24-41b0-9e3b-2287538f4788'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:54 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:54 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:54 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:54 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:54 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c09edb73-541c-4f81-b0e8-35fe7127af3c -F qcow2 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149" returned: 0 in 0.445s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:54 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 is being set with open permissions: ugo+rw Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:54 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 Apr 02 10:38:54 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:54 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.403s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:54 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.381s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Deleted volume successfully. Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-aabb555e-b276-4d82-9164-cf48fd18b17c tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-726db77f-e376-47c8-a2af-2ad91c136e30-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:54 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Deleted volume successfully. Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a74fd303-d1ce-4106-a806-bffa78c2f4d2 tempest-CreateVolumesFromSnapshotTest-654744706 None] Lock "cinder-468bf296-8f57-434f-9b6d-635eeed46dbb-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:54 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149" returned: 0 in 0.402s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:54 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info Apr 02 10:38:54 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:54 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info" returned: 0 in 0.388s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:54 devstack cinder-volume[82391]: WARNING cinder.volume.drivers.remotefs [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info is being set with open permissions: ugo+rw Apr 02 10:38:54 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:54 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info Apr 02 10:38:54 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "cinder-quobyte-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335b408-db10-4bd7-b911-00675a54787e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:55 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 Apr 02 10:38:55 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:55 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.info" returned: 0 in 0.449s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.759s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:55 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-5e879519-1184-4dc2-ae0c-1dc9c3b3ebbe tempest-CinderUnicodeTest-946972067 None] Create snapshot completed successfully Apr 02 10:38:55 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" returned: 0 in 0.524s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:55 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26 Apr 02 10:38:55 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-7c8ab5c0-d22d-4fbd-a54d-f47056e74149-delete_snapshot" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Lock "cinder-7c8ab5c0-d22d-4fbd-a54d-f47056e74149-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-quobyte-c09edb73-541c-4f81-b0e8-35fe7127af3c" by "delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-c09edb73-541c-4f81-b0e8-35fe7127af3c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-quobyte-7c8ab5c0-d22d-4fbd-a54d-f47056e74149" by "_delete_snapshot" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-7c8ab5c0-d22d-4fbd-a54d-f47056e74149" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Deleting offline snapshot 7c8ab5c0-d22d-4fbd-a54d-f47056e74149 of volume c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] snapshot_file for this snap is: volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 {{(pid=82391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18971f7-8ff6-4753-b644-c5ca2fe8f60e]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:55 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:55 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 Apr 02 10:38:55 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:56 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" returned: 0 in 0.437s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-quobyte-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26" released by "delete_volume" :: held 1.009s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Created reservations ['26c9bd5e-e9cb-46a7-ab05-af74403f8cf0', 'cdbb558f-745a-4e70-a330-470d7599c452', 'd62358d5-91cc-4af8-b68b-5ccb8512e303', '2ee6ecdc-ffa0-4f89-b043-bf60e9131583'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:56 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:56 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:56 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149" returned: 0 in 0.571s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.remotefs [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c09edb73-541c-4f81-b0e8-35fe7127af3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1540bc0-5c82-4986-93e0-2c18d4175133]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:56 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c Apr 02 10:38:56 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:56 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.458s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:38:56 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Deleted volume successfully. Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-f5935841-be25-461b-84ba-281c7583d812 tempest-VolumeDependencyTests-1705136307 None] Lock "cinder-842b83e9-bcf8-4939-a6d3-a50b1fa9cc26-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:56 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c" returned: 0 in 0.492s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:56 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:56 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 Apr 02 10:38:56 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:57 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149" returned: 0 in 0.506s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:57 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149 Apr 02 10:38:57 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:57 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c.7c8ab5c0-d22d-4fbd-a54d-f47056e74149" returned: 0 in 0.375s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-7c8ab5c0-d22d-4fbd-a54d-f47056e74149" released by "_delete_snapshot" :: held 2.006s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-c09edb73-541c-4f81-b0e8-35fe7127af3c" released by "delete_snapshot" :: held 2.022s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Created reservations ['295a898a-7be7-4d10-8747-cddedf2b97f5', '4868689c-dfe0-47e2-978a-d900016460ae', '37259ac5-1efa-463f-ae45-aa3ea22243a7', 'af763d3a-9206-4731-a6fb-a0bba3283641'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:57 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Delete snapshot completed successfully. Apr 02 10:38:57 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-d1ace3a1-beaa-4cc3-a73b-1f51291cf80f tempest-CinderUnicodeTest-946972067 None] Lock "cinder-7c8ab5c0-d22d-4fbd-a54d-f47056e74149-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-c09edb73-541c-4f81-b0e8-35fe7127af3c-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-c09edb73-541c-4f81-b0e8-35fe7127af3c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:UPDATE=286,cinder:SELECT=203,cinder:INSERT=60,cinder:DELETE=27 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-quobyte-c09edb73-541c-4f81-b0e8-35fe7127af3c" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-c09edb73-541c-4f81-b0e8-35fe7127af3c" acquired by "delete_volume" :: waited 0.010s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc5a9a-3979-4f3b-8cc8-0399a3bc9758]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:38:58 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:59 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c Apr 02 10:38:59 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:59 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c" returned: 0 in 0.475s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:59 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c Apr 02 10:38:59 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:38:59 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-c09edb73-541c-4f81-b0e8-35fe7127af3c" returned: 0 in 0.397s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-c09edb73-541c-4f81-b0e8-35fe7127af3c" released by "delete_volume" :: held 0.900s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=211,cinder:UPDATE=289,cinder:INSERT=77,cinder:DELETE=25 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Created reservations ['0e28eed9-8b54-4885-a36a-1662a007337b', '9d6e839d-40ff-4437-be00-4bbc768f4188', '567f8d5b-58b9-46e9-89d8-57cb5fee8b56', '762257e4-2b96-4727-9d6a-b3e3ee8d3dd2'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:38:59 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:38:59 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:38:59 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-1969bef6-26f6-44be-b677-04db49129bfe-delete_volume" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-1969bef6-26f6-44be-b677-04db49129bfe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Acquiring lock "cinder-quobyte-1969bef6-26f6-44be-b677-04db49129bfe" by "delete_volume" {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-1969bef6-26f6-44be-b677-04db49129bfe" acquired by "delete_volume" :: waited 0.008s {{(pid=82391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5ee3d-d86d-41c4-9b92-f5f8eb4f076a]: (4, 'qcow2') {{(pid=83188) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:39:00 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe Apr 02 10:39:00 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:39:00 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.461s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:39:00 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Deleted volume successfully. Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-b8ba45ba-e2f3-449e-82c2-b01f57a1a2a3 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-c09edb73-541c-4f81-b0e8-35fe7127af3c-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:39:00 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe" returned: 0 in 0.467s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:39:00 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe Apr 02 10:39:00 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:39:00 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5/volume-1969bef6-26f6-44be-b677-04db49129bfe" returned: 0 in 0.389s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-quobyte-1969bef6-26f6-44be-b677-04db49129bfe" released by "delete_volume" :: held 0.877s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:39:00 devstack cinder-volume[82391]: DEBUG cinder.quota [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Created reservations ['64738e47-d931-4f5f-9281-43b8dccd9062', 'dc54a380-e802-44df-beb6-6db3ab7d8b91', '133c0859-0e77-458d-b2a9-30e804b3feba', '0bde9eb5-5089-42ac-9bef-400595c6e799'] {{(pid=82391) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372': None} {{(pid=82391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG cinder.volume.drivers.quobyte [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e7ee72fc-ae7f-4db4-bb0d-1477f015f372'] {{(pid=82391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.lockutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 02 10:39:01 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5 Apr 02 10:39:01 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 02 10:39:01 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG oslo_concurrency.processutils [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/343461ae93259dd69dcf4e98edd4d6b5" returned: 0 in 0.441s {{(pid=82391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG cinder.manager [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Notifying Schedulers of capabilities ... {{(pid=82391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 02 10:39:01 devstack cinder-volume[82391]: INFO cinder.volume.manager [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Deleted volume successfully. Apr 02 10:39:01 devstack cinder-volume[82391]: DEBUG cinder.coordination [None req-a0ad8586-8ddd-481f-9c59-e962710a2a44 tempest-CinderUnicodeTest-946972067 None] Lock "cinder-1969bef6-26f6-44be-b677-04db49129bfe-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82391) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 02 10:39:11 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:INSERT=3,cinder:UPDATE=21,cinder:SELECT=9 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 02 10:39:11 devstack cinder-volume[82391]: DEBUG dbcounter [-] [82391] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=82391) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}